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ABSTBACT 

A description of the Oregon Total Information System 
(OTIS) project is presented. The purpose of the three year project 
was to improve education and xts administration by implementing and 
demonstrating a total information system vhich could provide data 
processing services to school districts of varying sizes over a large 
geographic region. The report describes: 1) the context and scope of 
the program; 2) the administrative and student data processing 
services provided; 3) the organizational structure and flov of 
responsibility within OTIS; 4) the system's hardware and software; 
and 5) an evaluation of the project and a summary of benefits flowing 
from it. Nine appendixes present details on users, teleprocessing 
statistics, costs, user evaluations, evaluations by two outside 
consultants and recommendations submitted by three state agencies. 
(PB) 
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CONTEXT 



Locale Project OTIS, as its name implies, is a regional activity 
encompassing all of Oregon as its territory. Since the original 
goal of the project was to act as a demonstration study of how 
data processing could be provided to school districts in a large 
geographic setting no matter their size or location, a variety 
of types of communities were selected. Included in the original 
group were districts representing urban, suburban, and rural 
areas • * 



AREA 


URBAN 


RURAL 


TOTAL 


Lane County Population 


122,810 


78,190 


201,000 


Umatilla County Population 


22,490 


21,010 


43,500 


City of Bend Population 


13,200 




13,200 


City of Coos Bay Population 


14,200 




14,200 


Parkrose District Population 


20,500 




20.500 


Total Project Area Population 


193,200 


99,200 


292,400 


Oregon State Population Distribution 


1,243,863 


755,917 


1,999,780 


Percent of Total Oregon Population 








Included In Project Area 


15.5 


13.1 


14.6 



The five initial participating areas present d widely divergent 



^Demographic figures taken from: (1) 1967*68 Oregon Blue Book; 
(2) A Demographic Analysis of the State of Oregon, 1965. 
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educational and cultural picture; yet, together their divergences 
closely resemble the larger state-wide situation. 

Lane County , located In the mld-Wlllamette Valley, Is Oregon's 
second largest metropolitan area and the fifth largest In the 
Pacific Northwest. It Is a railway center, a rich agricultural 
area, the country's leading plywood producer, and the home of 
the University of Oregon. The urban population Is located In 
the Eugene-Sprlngf leld area. 

Umatilla County , located In the northeastern section of the 
state, Is a region of authentic western character. The econ- 
omy of the area depends largely on cattle ranching and wheat 
farming. The population Is almost equally divided between 
rural and urban. The major community Is Pendleton, the county 
seat. Blue Mountain Community College Is located In Pendleton. 
About four per cent of the county's population Is Indian with the 
Nez Perce the major tribe. 

Bend Is a picturesque community located on the central Oregon 
plateau at the base of the Cascade Mountains. It Is the Deschutes 
county seat and site of Central Oregon Community College. Princi- 
pal products of the area are lumber and cattle. It Is a major 
recreation center for hunting, fishing, and skiing. 

Coos Bay is located on one of the finest natural harbors on the 
Pacific coast. It is Oregon's major lumber shipping port as well 



as a commercial fishing center. Southwestern Oregon Community 
College is located in Coos Bay* 

Parkrose District (Suburban Portland) is a suburban community lo- 
cated on the eastern edge of the city of Portland. It is a middle 
income residential district comprised of homes and shopping centers. 
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School Systems Served Initially OTIS served 28 school districts in 
six counties. Of those districts only one, Parkrose, dropped out 
of the project. Parkrose was faced with the problem (as other 
districts in the state face) of having to pay for two data pro- 
cessing systems and using only one since Multonomah County lED voted 
to provide data processing services to its schools by resolution. 

Subsequently, during the three years of operation, other districts 
have been added to the OTIS network. The following is a list of 
present OTIS users with original district members indicated by an 
asterisk. 



^Applegate District 
*Athena District 

Baker lED 

Beaver District 
*Bend District 
*Bethel District 
*Blachly District 

Cloverdale District 
*Coos Bay District 
*Creswell District 

Dallas District 
*Echo District 
^Eugene District 
*Fern Ridge District 

Hebo District 
*Hermiston District 
*Junction City District 
*Lowell District 
*Mapleton District 
*Marcola District 
*McKenzie District 



McMinnville District 
*Milton-Freewater District 
*Milton-Freewater Union High 

Mt. Hood Community College 

Neah-Kan-Nie District 

Nestucca District 

Northwest Regional Laboratory 
*Oakridge District 

Oregon State Dept. of Education 
*Pendleton District 
*Pleasant Hill District 

Reedsport District 

Roseburg District 
*Siuslaw District 
*South Lane District 
*Springfield District 

Tillamook District 

Tillamook lED 
*Tum-A-Lum District 
*Umapine District 
*Weston District 
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Needs Assessment Education is, in large measure, an information 
t*athering and processing system. The interaction between teachers, 
students, parents, administrators, and classified school employees 
consumes enormous quantities of data and produces a great volume 
of information. The participants in this education process spend 
a large portion of their time collecting, storing, and retrieving 
information. Manual systems are no longer adequate to meet the 
needs of today ^s schools. 

In order to effectively individualize instruction and guidance, 
complete and detailed information regarding each student's apti- 
tudes, interests, goals, and progress is needed by teachers, 
counselors, and the student himself. 

Administrators at the building and district levels need a broader 
base of information coupled with a system having summary and 
exception reporting capabilities to aid in decision making and 
to assist in communication with parents, community, and state and 
federal agencies. 

Research and evaluation efforts to improve educational programs 
must be supported by large quantities of accurate and consist evit 
data covering all aspects of school operation. Powerful statistical 
and analytical tools are required to make comprehensive evaluation. 
Simulation techniques need to be applied to educational models to 
provide greater predictability for education experimentation. 
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The needs described above were determined as a result of three 
activities. The Bureau of Education Research at the University 
of Oregon was contracted to conduct a state-wide survey of cur- 
rent school district Information handling practices. This sum- 
mary Involved the collection of over 500 school data forms for 
20 representative district. 

In order to further determine the needs of individual districts 
and to keep them Informed about progress of the project, OTIS 
staff members made more than 100 visitations in school through- 
out the state. 

Selected members of the project staff visited leading educational 
data processing installations throughout the United States in 
order to verify the general educational and information procesising 
needs . 

In all contacts with local, state, and federal school officials, 
there was general agreement of the urgent and manifold need for a 
system to improve methods of handling and utilizing school infor- 
mation. 
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Hlstory The Oregon Total Information Systeir, billed as the largest 
educational data processing system In the nation, officially became 
operational on May 1, 1968, after a 21-month planning phase. From 
the Ideas of some far-sighted educators and an Initial planning pro- 
posal, the system has developed Into a working reality that Is re- 
garded by the U.S. Office of Education as a prototype of all total 
Information systems. OTIS Is funded through and administered by 
the Lane County Intermediate Education District. During Its first 
year of operation. Project OTIS served 28 school districts In 6 
counties throughout Oregon. Over 95,000 student records were 
entered In the Project's data banks along with school fiscal records 
and equipment Inventories. For the year 1970-1971 the OTIS pro- 
gram serviced 62 participants Including both school districts and 
lED offices. 

A project of such scope and size does not spring to life overnight. 
Intensive planning, research., and development went Into making OTIS 
an exemplary project that has received national Interest. 

Project OTIS was conceived by a number of local school administra- 
tors, working closely with the Lane Intermediate Education District 
and the Oregon State Department of Education. These educators 
recognized the increasing pressure on local and state education 
agencies for complete and current information. They saw that the 
then current methods of collecting, recording, and processing infor- 
mation on students, scheduling, and fiscal matters were simply not 
adequate. They realized that the cost of developing complete. 



automated Information systems for each of the school districts In 
Oregon would be prohibitive. And, they recognized that while the 
needs of a metropolitan district such as Eugene's differed greatly 
from those of a small rural district l^Iilastern Oregon, that each 
could benefit by utilizing the facilities of a central computer 
system. The answer seemed to lie In developing a new system — 
statewide In scope, with resources jointly shared and activities 
coordinated . It was with these concerns In mind that the Idea 
for OTIS was born. 

The planning phase of the project began on August 1, 1966, with 
receipt of $257,437 in grant funds. In developing their propo- 
sal for a Title III E.S.E.A. planning grant, the OTIS planning 
force determined two bread goals: 

1. to favlld and maintain a service organization that could 
provide Oregon schools with the hardware and technical 
staff necessary to meet their computer requirements, and 

2. to develop with each user a plan that would assure indivi- 
dual district satisfaction as well as efficient and econo- 
mical utilization of the OTIS hardware and staff. 

The OTIS planning force felt that Oregon possessed attributes that 
would make it an ideal ground for a statewide informational system 
as did the U.S. Office of Education (Title III ESEA) . 1) While it 
is the tenth largest state in the Union, Oregon has a relatively 
small population of Just over two million. The 365 school districts 
vary greatly in both physical size and population. 2) Educators in 
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Oregon have long enjoyed a spirit of cooperation; and In an effort 
to equalize the educational opportunity for all children In the 
state; the various districts have Interacted and cooperated through 
Intermediate Education Districts and other agencies. Oregon edu- 
cators have also shown a willingness to Innovate. 3) Another 
factor that made Oregon "ripe" for a system such as OTIS was the 
fact that there had been no previous proliferation of data pro- 
cesslng systems. Vhlle there was great Interest In computers and 
their applications, no large aystem has been developed. 

It was determined that OTIS should offer to Oregon elementary 
and secondary schools services In all aspects of the educational 
system — students, staffs curriculum, property, and finance. It 
was also decided that the system would be responsive to the needs 
and desires of the local school districts and would be controlled 
and supported by them. 



-11- 



SCOPE OF THE PROGRAM 

At present OTIS participants number 58 Oregon school districts as 
well as services for community colleges, lED offices, and state 
and federally funded agencies. The Initial and continuing overall 
objective of .the OTIS project Is to Improve education and Its 
administration by Implementing and demonstrating a data processing 
system utilizing a teleprocessing network to allow the use of one 
large computer to process files for a large number of school dis- 
tricts. 

TELEPROCESSING NETWORK A teleprocessing system offers three major 
advantages over delivery type systems: Increased speed, accuracy, 
and flexibility. 
Speed 

Any ground delivery type system presents a system lag. For example. 
If a school In Umatilla County Is to have data delivered to a 
computer center In Eugene, It would take approximately two travel 
days. Assuming that the data could be logged In, scheduled for the 
computer, processed, and logged out all In one day, two more days 
would still be required to return the data to the sending school. 
The job would require at least five and possibly eight working 
days — one and one-half weeks — to determine If the data was processed 
correctly. If the data from Umatilla dealt with the enrollment of 
a student Into class, waiting one week for the student's new sched- 
ule would be much too long to have the operation be much more than 
an extra record-keeping chore. For inquiry to Information contained 
In the files, a response would be at best accurate up to the day 
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before the request was made* An answer would not be received until 
about a week after it was requested. Also the system would be 
relatively unresponsive to the individual school's request for 
special status reports since each request would require special 
manual attention at the computer center* 

If system users are to haye on file the kinds and volumes of 
information that they will need, the information system will 
have to provide more than an historic record-keeping system which 
offers data too late to be of any real value. Schools* infor- 
mation must be as accessible with OTIS as it currently is with 
the schools* manual method. 

An additional advantage of a teleprocessing system over a deliv- 
ery sy-^tem is the ability to correct erroneous information. With 
a teleprocessing system, the user need only enter the correcting 
information and an immediate verification is printed as the change 
is made. The user knows immediately if a change must be re-entered. 
In a delivery system, however, at least five days transpire before 
confirmation is received. After five or more days have passed, it 
is doubtful that the user will remember to check to see if the error 
was corre( ted. 
Accuracy 

A teleprocessing system proves to be of significant value in main- 
taining accurate records in the system. As mentioned earlier, data 
errors on the OTIS files can be corrected over the terminal immed- 
iately upon discovery. The system is also able to coach the user. 
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that Is, Inform him what data should be entered and the type of 

format to be used. 

Flexibility 

The OTIS teleprocessing system is much more flexible than a stan- 
dard computer system. Short reports and summaries can be requested 
over the terminal and will be handled completely by machine. This 
provides a major breakthrough in the use of online data. Few com- 
puter installations today are willing to handle a large volume of 
small reports. The time required for a computer center's staff 
to log in a request, set up the job, get the job on the computer, 
the results back from the computer, and log the results out makes 
this a completely uneconomical application because of the manual 
work required. In OTIS, however, the user need only communicate 
to the system over the terminal the report or summary desired. 
The computer then handles the preparation of the report and sub- 
sequently transmits the report back over the lines to the user's 
terminal. 

In general, the OTIS teleprocessing system will give the user 
the speed, accuracy, and flexibility of a computer system in his 
own building without the problems involved in creating, maintain- 
ing, or operating the system. 

GEMS The Generalized Education Management System (GEMS) is the 
software heart of the OTIS project. Developed during the first 
year of funding it allows the collection of data independent files 
that are then combined to produce required reports. The design of 

ERIC 
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GEMS Is oriented toward change and expansion. It Is a generalized 
Information management system that Is controlled by variable pa- 
rameters established by the user districts. By manipulating the 
parameters. Input, output, files, segments, and fields can be added, 
deleted, or altered without reprogrammlng . 

DATA BANK The data bank created for each participating school 
consists of five files of Information. Detailed data concerning 
students, staff, curriculum, facilities, and finances Is stored 
on random access devices In such a way as to permit Information 
from any one of the files to be related to that from any other. 
Each file Is subdivided Into records, segments, and fields. For 
example, each record In the student file will pertain to one 
student. Each segment In one student *s record will contain 
common data relating to specific applications (such as class 
schedule) . Each field In this segment will contain one piece of 
the schedule (such as his first period class). This method of 
storing data allows for unlimited expansion and maximum flexi- 
bility because the number of fields, segments, and records will 
not be fixed, but will be Individually specified according to 
each user district's needs. With this method, an Item of Infor- 
mation Is easily accessible and needs to be stored In only one 
location In the data bank. 



ADMINISTRATIVE AND INSTRUCTIONAL SERVICES 

A primary objective of the system was to provide business and student 
services In support of the administration and Instruction Involved In 
dally school operations. The following sections describe the services 
presently being provided. Due to the flexibility of the system (GEMS, 
the teleprocessing network, the Integrated data bank), providing these 
services Is merely the utilization of a set of multipurpose tools; 
services can be added, altered, and Implemented easily and rapidly as 
changes to the design develop as a result of continual evaluation by 
OTIS analysts and user coordinators. 

BUSINESS SERVICES 
General Ledger The fiscal accounting system for Oregon school dis- 
tricts is maintained in a manner consistent with generally accepted 
school accounting procedures and in conformity with the requirements 
of the State of Oregon. 

The basis of the fiscal system is the general ledger. A general 
ledger is maintained for each fund within each district. The ac- 
counts within each ledger are classified as required in the State 
of Oregon's School Business Management No. 2 , which was drawn from 
the U.S. Office of Education's Financial Accounting for Local and 
State School Systm s. 

Input is by terminal with processing at night. Each account is 

current as of the previous day's changes. Output reports consist of: 
Vendor Checks 
Financial Statements 
General Ledger Transactions 
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Check Register 

Paid Invoice List 

Unpaid Invoice List 

Outstanding Purchase Order List 

Outstanding Purchase Order List by Account 

Invoice List by Account Number 

Daily Error List 

Summation Report (quarterly reports) 



Payroll The payroll system has been developed as an aojunct of the 
general ledger system. It may stand alone or operates as part of 
the total fiscal system. 

Input is via terminal and consists of a master employee record, 
monthly changes to existing records, terminations, and time and 
adjustments. From this information the current payroll is computed 
and payroll checks, payroll register, and deduction registers are 
produced at OTIS central and delivered to user districts. Also 
produced from the payroll system are managerial reports such as: 

1. Year-to-date reports 

2. Post to general ledger 

3. Payroll distribution reports 

4. Tax reports for federal and local agencies 

5. Special deduction reports such as investment and 
retirement witholdlngs. 

Inventory Using whatever data the school district initially has, the 
school's inventory of equipment is built into an Inventory file. Ad- 
ditions and deletions to the inventory are made via terminal. Users 
can Inquire via termiual for the status and location of items of 
equipment, extract reports specific to their needs, or have total 
inventory reports printed by OTIS on a routine or request basis. 
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Personnel The personnel file contains inforaation on both classified 
and certified district employees. From this file are extracted the 
necessary data to provide the state and county with district personnel 
information. Inquiries may be made via terminal as to status of any 
personnel and additional reports are available for district use such 
as: 

Termination statistics 

Personnel salary projections (for district budget board) 
Annual leave report 
Health card report 
Retirement report 
Appointment list 

OTIS Automated Library System The OTIS Automated Library System is 
an automated total system for libraries • It has batch-processed 
and on-line acquisitions > processing, and cataloging ability with 
inquiry and report capabilities. The system provides: 

1. Purchase Orders 

2. Title-on-Order Report by district and by library 

3. Processing Kit including catalog and shelf cards, 
book pocket, borrower's card, and spine label. 

4. Updated Financial Reports 

5. Invoice scan sheet preprinted with complete order 
Information 

6. Check and voucher for each vendor, monthly 

7. Titles Received Report 

8. Outstanding Purchase Orders Report and Claim Notices 

9. Titles Cancelled Report 

10. An annual Vendor Performance Report 

If the district's inventory information is currently held in the 
library data bank, inventory records will be updated automatically; 
als^i if the district is using the OTIS Fiscal program the proper 
account records will be updated automatically. 
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STUDENT SERVICES 

The Student Services System has been designed with the thought In 
mind of serving the dally administrative, accounting, and reporting 
needs of the Individual school. The data bank content has been 
determined In order to provide the Information necessary to Insure 
Individualized attention and support to people Involved In the ad- 
ministration. Instruction, counseling, and guidance of the Individ- 
ual student. 

Enrollment Reports 

Locator Cards This report consists of 4 copies of 4 X 5 cards con- 
taining some 35 Items of Information for elementary plus a schedule 
for secondary students. A complete set of locators for each school 
Is run twice a year. A new set of locators Is also generated for a 
student when a change occurs In the data or schedule Information. 

Rosters This list Is produced once a month for both elementary and 
secondary schools. The students are listed alphabetically within 
grade In each school. It contains the student name, grade, sex, 
enrollment status, and enrollment date. Only the students that are 
actively enrolled In the school are printed. 

Class Rosters 
1 . Temporary : 

This list Is produced for secondary schools only. Each student 
Is listed alphabetically within each course that the school Is 
teaching. It Is produced at the beginning of school on the temporary 
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class list form which allows for 4 weeks use. 
2. Perman€*nt : 

This list is the same as above excq)t that the form is different 
and allows for the teacher's use the rest of the semester. It 
is produced twice a year — at the beginning of school after the 
temporary class lists are printed and after the schools have had 
time to update their records but before the 4 weeks is over that 
the temporary rosters can handle. It is also generated at the 
beginning of 2nd semester. 

Student Data Verification This is printed on a single copy contin- 
uous form data sheet. All the information on file is printed in the 
correct location on the data sheet and sent to the schools for veri- 
fication. These data sheets are produced during the second semester 
and just prior to the beginning of school in the fall. 

Mailing Labels These are gummed address labels, 2 labels side by 
side. The same name and address is printed on both labels. The 
student's Parent or Guardian name is used. These labels are produced 
on a request basis except at the beginning of the school year when 1 
set of labels is produced for each school. 

Directories There are 3 different directories involved. One list 
Is alphabetic within school and is sent to the school. The second 
list is alphabetic within district and is sent to the district office 
and the district coordinator. These 2 lists are run twice a year, 
once during the 1st quarter and once during the 3rd quarter. The 
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third list Is the same except It Is sequenced on the Parent /Guar- 
dian name and phone number within district to group all children 
in one family together. This list is used for census purposes and 
is run on request. A maximum of two census reports may be produced 
per year. 

Master Schedule Listing This list is produced onoea month for all 
schools that have a master schedule entered in the data bank. The 
sequence is course, section, phase within school and lists all of 
the information entered for each course, section, and phase. 

Locker Liscs There are two lists involved; one is the list of locker 
numbers sequentially arranged showing the name, sex and grade of the 
student assigned to that locker. The other is a list showing the 
same information but arranged alphabetically (student name). These 
lists are run twice a year, once in the 1st quarter and once in the 
3rd quarter. 

Counselor List This list is run at the same time as the locker 
lists. The list contains the name, grade, and sex of each student. 
The sequence is alphabetic (student name) within counselor name. 

Mark Reporting 

Prior to the Grade Marking Cycle, each school is furnished verifi- 
cation rosters showing the students on the OTIS files that are enrolled 
in each course. A sufficient period of time is allotted for each 
school to update the files, dropping students who are no longer in 
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that course and adding students who are enrolled but do not appear 
on the verification roster. The updates may be accomplished either 
via the terminal or supplied forms* 

The Grade Marking Cycle is initiated by preparing scanable Grade 
Marking sheets for each course to be graded. Each student enrolled 
in that course is listed on the scan sheet. 

Output Reports consist of: 

1. The Report Card. Two similar types of card format are avail- 
able. The essential difference is that type one shows class 
period absence and the previous grading period mark as well as 
the current period. Both type cards show the courses taken, 
the marks recorded, the CPA, days absent and teacher name. 
The Report Card is a snap-out mailable form, addressed "To 
the parents of..." 

2. A one-copy duplicate of the report card is produced for school 
use . 

Other reports produced from the Mark Reporting program are: 

1. A grade listing which is a year to date listing of the courses 
and grades for each student. 

2. A listing of all special grades recorded, i.e., no grade given, 
failures, incomplete, conditional grades, etc. is printed in 
alphabetical sequence for the school. 

3.. Honor Roll - A numeric ranking of CPA for each grade level in 
the school from 4.00 to 0.00. The report is sequenced by CPA 
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from high to low for each school. 

4. Grade analysis by teacher - a list of each teacher's courses 
showing the percentage of each type grade given. 

5. Grade analysis by course - a list of each course showing the 
percentage of each grade given. 

6. Permanent grade label - a gummed label prepared each semester 
showing courses and grades received for each student. 

Standardized Test Scoring 

A. Complete Test Scoring is offered for the following standard- 
ized tests: 

1. California Test of Mental Maturlty-1963 Short Form, Levels 
2, 3 and 4. 

2. Iowa Tests of Educational Development, 1964, Forms X«-4 
and Y-4, Class Period Version* and 1970, Forms X-5 and 
Y-5, Assessment Survey*. 

3. Stanford Achievement Batteries, 1964, Forms W and X. In- 
termediate I, Intermediate II and Advanced for Fall, Spring, 
or late Spring (past Hay 1st) testing. 

4. Gates - MacGlnitle Reading Test, Survey D, E, and F (all 
forms). Covers grades 4-12. 

B. The user receives: 

1. Pre-ldentlf led test answer sheets for each student on OTIS 
files in the grade to be tested. 

2. A sufficient supply of extra sheets to test new enrollees 
not yet on OTIS files. 

*for Fall or Spring testing. 
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Teacher-Made Tests 

OTIS provides standardized answer sheets for teacher use with 
teacher-made tests. These teacher-prepared tests are then scored 
by OTIS and the teacher Is provided with the following Information: 

1. Response Record . This section lists the students by name, 
and gives their raw score, rank In the group, percentile 
rank, T-Score, and Stanlne Score for the test given. It 
also gives a listing of the questions missed or omitted by 
each student. In addition the mean, median, and number of 
students taking the test is given. 

2. Frequency Distribution . This section lists the raw scores 
for the test along with the number of students receiving 
that score. In addition, the corresponding T-Score, Per- 
centile Rank, and Stanlne Score Is given for each raw score. 

3. Item Analysis . This section lists each Item showing the 
distribution of responses among the five options for each 
question and how many students omitted each question. This 
section also gives the number of correct responses, the 
number of Incorrect responses, an Index of Discrimination, 
an Index of Difficulty, and a Point-Blseral Coefficient of 
Validity for each question. 

4. Histogram of Raw Score Frequency . This section gives a 
graphic representation of the Raw Score Distribution for this 
test. 

5. Raw Score Summary Statistics and Definitions. This section 
contains a summary of statistics used In other sections. The 
statistics given are: Number of Students, First Quartlle, 
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Third Qu&rtlle, Median, Mean, Variance, Standard Deviation, 
Kuder-Rlchardson^ Formula 20 Estlioate of Reliability, and 
the Standard Error of Measurement. Also Included In this 
Is a descriptive definition of some of the terms used In 
the report. 

Attendance 

I. Data collection, verification and summary reports. 

A. Weekly printing of Attendance Data Gathering and Col- 
lection Form. 

1. Available alphabetically by school, by class, by 
home room teacher and by class period. 

B. Output Reports. 

1. Weekly Attendance Report. 

2. Monthly Attendance Report. 

3. Verification of Attendance (file dump). 

4. State Quarterly Report. 

a. Pupil Personnel Accounting Report. 

b. Verification Rep.rt to support item (a)* 

c. Error list of Inconsistent data. 

II. Attendance by Mark Reporting Periods. 

A. Days absent and days present by each Report Card Interval 
— primarily for elementary schools. 

Student Scheduling 

A. Loader Type - The loader scheduiAng program offered Is de- 
signed to load students Into class sections of a master sche*- 
dule developed by the school administrator. Thus, the master 



schedule can be appreciably expanded and the computer used as a 
tool for checking validity of Information and for student tallies 
and conflict matrices. Three types of material are produced In 
this system. 

A. Tally Reports (these reports are also produced for student 
forecasting). 

1. Course request tally. 

A list of each course offered, Itemizing the count by 
grade level and sex for each course. 

2. A list of each student and his course requests. 

3. A list of each course and the names of each student request- 
ing the course. 

Conflict analysis reports. 

1. Singleton conflict matrix* 

A conflict matrix of the singleton courses, plus a list 
of each student's name and singleton requests. 

2. A singleton and doubleton conflict matrix. 
C. Master schedule lists. 

1. A listing of the master schedule by course and selection 
number. 

2. A listing of the master schedule by each period in the 
school's day. 

3. A listing of the master schedule by teacher. 

4. A listing of the master schedule by room. 

Simulation runs and schedule loading involve the following steps: 
1. Schedule simulation runs. 



A simulation run Is a achedullng run In which sections are 
allowed to become out of balance so that the principal can 
tell where to move course sections to Improve the mastez 
schedule. The updated master schedule and student conflicts 
are printed. 

2. Normal schedule run. 

The loading of students Into course sections, honoring course 
section balance. The updated master schedule, student con- 
flicts and student schedules are printed. 

3. The student schedules are formated In machine readable form 
which becomes Input to the student data bank. 

Generator Type Scheduling 

Flexible modular schedules are created by these programs which 
are designed to allow the creation of the most complex master 
schedules desired by the school principal. The principal pro- 
vides information about students, teachers, and rooms to approach 
the optimum master schedule for the school. Modular Schedule 
Generation is contracted for through Educational Coordinates of 
Palo Alto. 

Reports are produced to assist the principal in evaluating the 
progress made by tha program and the principal at each step in the 
master schedules development. The final output consists of a 
Master Schedule, class lists, student, teacher and room schedules. 
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Problem Solving IBM's Interactive Terminal Facility (ITF) is 
a time sharing system that operates concurrently with the OTIS 
GEMS system via teleprocessing during the school day. The 
language available is Basic and IBM's PL/1. This system allows 
students, using a terminal, to interact with a computer, write, 
stop, and recall their own computer programs. Districts can 
also write or obtain programs to be available for students 
through ITF problem solving. 

OIAS Bruce McKinlay, Project. Director Occupational Information 
Access System (OIAS), University of Oregon, has developed a pro- 
gram which provides a terminal interaction with students Inter- 
ested in gathering information on occi^ations based on their own . 
individual strengths and interests. OTIS is capable of providing 
this service to user schools via teleprocessing concurrently 
with other programs operating during the school day. 

Health Report Preprinted forms are provided the school nurse to 
gather student health information. A letter to parents is gener-* 
ated as a reminder if there is a need for Innoculations or atten- 
tion to a particular health problem. Summary statistics are also 
provided. 

QUERY One of the primary objectives of the OTIS Project was the 
application of the power of a large computer to the problems of 
education management. It was envisioned that through the develop- 
ment of separate files of information and the GEMS software system 
new reports and statistical analyses could be produced by entering 
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QUERY 
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the requested report content and format as well as the report 
parameters via terminal and having an immediate, one-^tlme report 
produced. The QUERY program provides such a tool. 

The QUERY system provides a user-generated report without Inter- 
action with an analyst or programmer. 

Using a simplified language an administrator keys In the format 
and the qualifications to the parameters of the report. The 
computer then searches the Indicated file, assembles the Infor- 
mation sorts and prints the report jver the user's manual. 
(See example) 



OTIS ADMINISTRATION 



While OTIS is funded through and l8 a part of the Lane County 
ZED, It has an advisory board oade up of representatives primarily 
from user districts (see page 36). The director of OTIS» an 
Oregon school administrator with some twenty-^nlne years experience 
In school district administration, Is rec^ponslble to the Lane 
County lED but Is advised along general objective lines by the 
advisory board. 

OTIS Coordination 

The need for good communication between human beings la any endeavor 
Is always present regardless of the scope of that endeavor. In a 
project the size and complexity of the Oregon Total Information Sys- 
tem, good comnunicatlon la absolutely essential. The large numbers 
of people Involved make it necessary to plan very carefully. Plans 
must be designed to insure good comnunications between the individual 
district personnel and the OTIS center. 

Unique training needs arise from terminal usage and the technical 
knowledge required for their proper use. Controlling the accuracy 
of data input, understanding and utilization of the system output, 
and knowledge concerning computer capabilities are just some of the 
areas requiring special attention. 

Coordination Structure 

In order to satisfy communication needs, OTIS has established a 



central organizational branch devoted to coordination, evaluation, 

and dlsbemination. Field coordinators are added to the staff 

as the number of participating districts increase. Their primary 

function is to instruct system users, to receive suggestions which 

will facilitate system improvements, to reconciend modifications, 

to publish manuals, and to engage in any and all activities Intended 

to keep the communication lines open and flowing freely. 

A coordination network involving many school district personnel 
has been formed. Each district coordinator works with building 
coordinators who in turn work with teachers and administrators 
for each school building. The philosphy behind the extensive in- 
volvement of district personnel rests with the fact that the sys* 
tern being developed belongs to and serves its participants, it 
cannot function independently from school personnel but requires 
that they fully appreciate their role. Since all data originates 
in the districts, the responsibility for its accuracy falls there. 
Since system output is designed primarily for district use, con- 
stant vigilance must be maintained to assure quality and provide 
feedback to the computer center when difficulties arise. It 
is also imperative that school personnel be thoroughly instructed 
on the use and interpretation of printed reports. 

The coordination structure shown on page 37 is designed to pro- 
vide open lines of communication. It is important to recognize 
that the flow of communication is both to and from the districts 
and the OTIS center. 
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Responslbllltlea of the Dlatrlct Coordinator 

The key to the success of a district's participation in OTIS Is 
Its coordinator. In order to participate, a district must employ 
a full- or part-time coordinator. His qualifications Include: 
Administrative experience (administrative and teaching credentials 
preferred). Orderly and logical mind, a problem solver. Works veil 
with people. An interest in educational data processing. A person 
the district would select for promotion. 

His responsibilities include: The Data Processing Coordinator will 
be the contact man in his district for all data processing activi- 
ties. In this capacity he will: 

1. Derive his authority directly from the superintendent of his 
district. 

2. Serve as the interface with OTIS staff. 

3. Attend all required coordinator meetings. 

4. Establish the communication network for DP in his district. 

5. Assume personal responsibility for the DP activities in his 
district. 

6. Be responsible for establishing and maintaining schedules and 
quality in his district. 

7. Be responsible for identifying, planningi and presenting all 
required data processing in-service training in his district. 

Monthly meetings are held between district coordinators and OTIS 
staff members. These meetings act not only to convey information 
to school districts but as training sessions on technical aspects 
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of Importance to the district, feed-back on problems or potential- 
problem areas, and as a sounding board for potential nev applications. 

Coordinators, working with OTIS Field Service representatives, or 
alone, promote Inservlce training for district staff members In- 
volved In data collection and dissemination. 

OTIS STAFF 

OTIS Is primarily a data processing organization serving educa- 
tional organizations. Through training, hiring of employees with 
educational backgrounds, and Interaction between OTIS staff members 
and users, the organization has become highly sophisticated not 
only In data processing applications but In the understanding of 
unique school problems and the application of computer technology 
to educational problems where such applications are appropriate. 

Early programming and analytical work involved considerable inter- 
action between school administrators and OTIS staff In shaping the 
format and context of reports. Presently OTIS has reached a level 
of program development where Its primary programming emphasis Is 
one of maintenance and refinement of existing programs. 

Contained within the OTIS staff are Field Representatives » whose 
primary responsibility Is dealing directly with the field (whether 
district coordinator, staff, or administrators) to Improve communi- 
cations, solve problems, and train new users. 
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OTIS ADVISORY BOARD 



Walt Commons, Superintendent 
Jackson County I.E.D. 
1133 S. Riverside 
Medford, Oregon 97501 
Phone 779-5510 

Tom Calkins, Superintendent 
Josephine County Unit 
706 N. W. A Street 
Grants Pass, Oregon 97526 
Phone 476-7721 

John Crowley, Superintendent 
Coos Bay School District #9 
P. 0. Box 509 
Coos Bay, Oregon 97420 
Phone 267-3104 

Bill Dahlien, Superintendent 
Tillamook School District #9 
P. 0. Box 469 
Tillamook, Oregon 97141 
Phone 842-4415 

R. E. Jewell, Superintendent 
Bend School District #1 
Foot of Broadway 
Bend, Oregon 97701 
Phone 382-8221 

Dr. William C. Jones, Superintendent 
Lane County I.E.D. 
748 Pearl Street 
Eugene, Oregon 97401 
Phone 342-5576 

Claude C. Kartin, Superintendent 
Neah-Kan-Nie School District #56 
P. 0. Box 15 
Rockaway, Oregon 97136 
Phone 355-2222 

Raymond A. Mullen, Superintendent 
South Lane School District /M5J 
103 S. 5th Street 
Cottage Grove, Oregon 97424 
Phone 942-3381 

Donald Murray, Superintendent 
Pilot Rock School District #2 
P« 0. Box BB 

Pilot Rock, Oregon 97868 



Vernon Oaborn, Deputy Superintendent 

State Board of Education 

942 Lancaster Drive N, E. 

North Building 

Salem, Oregon 97310 

Phone 364-2171 X2758 

Ellis H. Heal, Superintendent 
Pendleton School District #16 
1207 S. W. Frazer Avenue 
Pendleton, Oregon 97801 
Phone 2766711 

Dr. Millard Pond, Superintendent 
Eugene School District #4 
200 North Monroe 
Eugene, Oregon 97402 
Phone 342-5611 

Tom Rlgby, Executive Secretary of 

School Boards 
Room 216 

Education Building 
University of Oregon 
Eugene, Oregon 97403 
Phone 342-1411 X1288 

R. J. Schwalenberg, Superintendent 
McMinnville School District #40 
1500 N. Baker Street 
McMinnville, Oregon 97128 
Phone 472-4101 

Richard Scott, Superintendent 
Fern Ridge School District #28J 
Elmira, Oregon 97437 
Phone 935-2253 

Ken Stanhope, Superintendent 
Umatilla County I.E.D. 
404 S. E. Dorion Street 
Box 38 

Pendleton, Oregon 97801 
Phone 276-6616 
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DISTRICT COORDINATTON STRUCTURE 
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OTIS SYSTEM SOFTWARE & HARDWARE CONFIGURATION 



Operating System : OTIS operates under the full OS/360-MVT Control 
Program which provides for the concurrent scheduling of a variable 
number of Jobs In a dynamic environment. Jobs In an OS/360 multi- 
programming environment are protected from alteration by other user 
programs, systems programs » or Input/output operations through 
OS/360 support of the storage protection feature. Our full multi- 
programming support Is designed to Increase system through-put 
and decrease Job turn-around time while optimizing the use of the 
system resources. 

Language Processors : A wide range of language compilers and 
assemblers that contain powerful diagnostic capabilities Is avail- 
able on the OTIS system. These Include PL/1, COBOL, FORTRAN, RPG, 
ALGOL, and Assembler Language. 

Telepro cess Ing ; Remote terminal controls and data transmission 
requirements can be handled simultaneously with other processing 
through the multiprogramming facilities of OS/360. Our use of the 
Queued Telecommunications Access Method (QTAM) to construct tele- 
communications service provides the bonus facilities to perform 
error recovery, error logging, on-line terminal tests, and other 
functions that Increase system availability. 

Hardware Configuration ; An IBM S/360 Model 50 with attached 2361 
Core Storage, Model 1, provides 1,179,648 bytes of directly ad- 
dressable core memory. This Is one of the largest In the North-* 
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vest and allows us to run jobs requiring extremely large amounts 

of core storage. Input/output devices include: 

4 - 2400 Series Magnetic Tape Units - (9 track R/W heads , 
800 BPI recording density.) 

2 - 2314 Direct Access Storage Facilities - (Each stores 
233,400,000 bytes or 466,800,000 packed digits 
on 8 removable disk packs.) 

1 2321 Data Cell Drive, Model 1 - (Capacity of 400 

million bytes or 800 million packed digits on-line.) 

1 - 2540 Card Read Punch - (Reads 1000 cards per minute, 
punches 300 cards per minute.) 

1 - 1403 Printer, Model Nl - (Line width 132 print posi- 
tions, print rate 1,100 lines per minute.) 

For telecommunications, users can choose either IBM 2740 Communi- 
cations Terminals or TTY-33 Teletype Terminals as their needs 
dictate. 

OBJECTIVES 

The educational goal of Project OTIS is described in the first 
sentence of the original title proposed. "The purpose of the 
three year operational phase described herein is to improve ed- 
ucation and its administration by implementing and demonstrating 
the Oregon Total Information System". A demonstration project is 
primarily concerned with process rather than product evaluation. 
Several methods have been utilized to describe OTIS activities 
and some attempts have been made to consider the product as Judged 
by users of the system. 

Performance Objectives 

Performance objectives grew out of needs assessment and reflect 

ERIC 
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actlvltles aimed at satisfying ascertained needs. 

A. To improve educational opportunities by building a total 
information service which will provide data and services 
for better administration and will aid in the individual- 
ization of instruction. 

B. To develop a generalized computer system which will; 

1. Create data banks in the five areas of source infor- 
mation (student, staff, curriculum, property, finance). 

2. Process a variety of applications under a single pro- 
grammed control system (GEMS) having analytical capa- 
bilities for comparing, correlating, manipulating and 
summarizing the information stored in the data bank. 

3. Provide for system expansion and revision without re- 
programning . 

4. Produce printed repcrts according to district speci- 
fications on a tuLTiuc'.ry or detailed level or by excep- 
tion. 

C. Development oi a teje-cionnunication network linking parti- 
cipating schoolfc to one large computer. 

D. Developnent oz a cooraination system linking schools and 
OTIS for mutual cotamunlcaticn and instruction. 
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SUMMARY 

If OTIS can be judged only on the attainment of the original goals 
set forth In the Title III proposal then It must be pronounced a 
success for In fact all the programs and systems originally pro- 
posed are presently In operation. In looking beyond the simple 
fact of operation It Is Important to also consider the quality 
of the work being done as well as future activities of OTIS. 



OTIS questionnaires have generally returned an average to above 
average response to questions concerning the quality of service. 
While In many Instances the only basis for user comparison of 
OTIS data processing services have been with manual operations 
or partially contracted services, the users seem to Indicate that 
the OTIS services are more efficient and wider ranging than those 
services that have been available to them In the past and that 
OTIS services are continuing to Improve In their estimation. 

As an educational data processing center the success of OTIS 
rests on several concepts that have proven viable. 

1. Shared resources by many school districts can provide the 
computer services normally available only to very large 
organizations. 

2. Total educational data processing needs can be provided from 
one centerallzed production point. 

3. The teJ eprocessing concept is acceptable to school personnel 
and proves to be more accurate, faster, and more flexible 

^ than batch operations. 
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4. The GEMS concept entailing separate files of Information which 
are manipulated by the computer through a generalized software 
system has proven capable of handling large numbers of dally 
transactions. Both business and student service activities 
are capable of being handled simultaneously, allowing the 
user to add, delete, alter or Inquire to any of his online 
files with a terminal response time of less than 10 seconds < 

5. The development of Query Is a unique service to Oregon 
schools and perhaps to the rest of the nation. For the 
first time the educator can query his files for information 
tailored to his own particular needs. The Query program 
avoids the problem of a one-time report in a batch mode which 
proves almost prohibitive since it normally must include login, 
logout time, programmer time, debugging time, and travel time 
to and from the computer center. 

Further activities of OTIS that should increase its efficiency or 
service to users are presently underway and in some instances near- 
ing production status. 

1. GEMS is being rewritten to increase its efficiency which in 
turn means faster terminal response time. 

2. Using the IBM problem solving package, OTIS will offer problem 
solving to Its user schools as an additional service during the 
1971-72 school year. By utilizing the existing terminal net- 
work, problem solving will be available to schools that could 
normally not afford dedicated problem solving terminals and 
lines. Instead a terminal command will switch their terminal 
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from business or student services to a problem solving 
mode. 

3. OIAS, piloted this year with three user schools, will 
also be available using the sane terminal arrangement 
as problem solving, that Is by a terminal command the 
existing terminal In the building can also be made avail* 
able for the Occupational Information Access program. 

Certain additional benciflts have accrued to Oregon education 
from the OTIS project that were not contemplated In most in- 
stances by the original proposal. 

1. Under a purchase agreement the Lane County lED Is acquiring 
data processing equipment worth $968,881. In the present 
fiscal year It wlll^have an equity of $177,628 In equip- 
ment. 

2. The Lane County lED as well as the other OTIS users has 
a highly trained staff of data processors available to 
them for their unique projects. 

3. OTIS users have received training In data processing for 
both employees and students and have become much more 

^' sophisticated in their understanding and use of data pro- 

cessing and its applications. 

4. OTIS has tended to increase cooperation among school 
personnel both at the county level and on a state-wide 
basis as well. It encourages a cooperative approach to 
county-wide activities such as testing, for example, as 
well as a sharing of knowledge about programs entailing 

^ data processing support. 
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It has tended toward more standardization of the kinds 
of Information stored, types of reports, and report format. 
It has Increased the application of better, more uniform 
methods of fiscal accounting and reporting procedures. 



The following reports are Included to denote the amount of usage 
of either various programs specified by school districts as 
necessary data processing activities, usage of the teleprocessing 
network, or development of the generalized computer system. 

1. Survey of users - programs. 

2. Teleprocessing statistics for 1970-71. 

3. Comparison of OTIS operating costs and service performed 
1968-69 to 1971-72. 

4. User evaluation. 

5. Touche, Ross, Bailey and Smart evaluation. 
6* State Department Recommendation. 

7. Advisory Board Recommendations. 

8. Peat, Marwick, Mitchell & Co« evaluation. 

9. Report by the State Department Advisory Committee on Data 
Processing. 



USER ACTIVITIES 



Prosram 




Number 


Fiscal 


20 


Districts 


Payroll 


33 


Districts 


Inventory 


6 


Districts 


Enrollment 


214 


Schools 


Attendance 


193 


Schools 


Mark Reporting 


64 


Schools 


Testing 


59,002 


Students scored 
1970-71 school year 


Census 


36 


Districts 


3S Scheduling 


75 


Schools 


EC Scheduling 


9 


Schools 


Problem Solving 


2 


Schools 


Automated Library System 


4 


Districts 


OIAS 


3 


Schools 


Personnel 


2 


Districts 
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OTIS TERMINAL TRANSACTIONS 1970-71 



Terminal Location 


Sept 
1970 


Oct 
1970 


Nov 
1970 


Dec 
1970 


Jan 
1971 


Feb 
1971 


Mar 
1971 


Baker I ED 


1A76 


889 


638 


A93 


27A 


A6A 


253 


Bend DA 


4298 


3186 


2569 


160A 


2123 


1708 


17A1 


Bend DO 


2091 


1187 


1627 


1911 


1A38 


2A73 


1332 


Bend Hi 


2511 


5381 


2A97 


1912 


1280 


3729 


2A67 


Bend Jr 


4233 


3309 


1550 


17A9 


1137 


1862 


1656 


Bethel DO 


2338 


28A0 


3097 


2621 


1573 


25A7 


23A6 


Bethel IH 


25U4 


20A6 


2866 


3772 


1657 


2187 


2192 


Blossom Gulch El 


4635 


A107 


5023 


3110 


17A9 


3AAA 


2A3A 


Briggs Jr 


924 


1336 


758 


744 


89A 


1090 


921 


Cal Young Jr 


628 


618 


A77 


383 


296 


361 


286 


Cascade Jr 


1012 


12A1 


113A 


631 


563 


880 


869 


Churchhill Hi 


2495 


1602 


1398 


646 


1396 


11300 


655A 


Colin Kelly Jr 


1320 


1155 


737 


781 


666 


1086 


775 


Coos DO 


2265 


2660 


2673 


1917 


1057 


2219 


2831 


Creole Jr 


237 


A86 


A99 


707 


756 


A6A 


A75 


Crow DO 


1117 


858 


A15 


753 


15A 


A 31 


310 


Crow Hi 


385 


172 


AO 


80 


60 


223 


90 


Creswell DO 


1513 


57A 


1309 


847 


313 


716 


995 


Creswell Hi 


13A0 


1029 


1198 


700 


A03 


956 


702 


Cottage Grove DO 


A029 


3699 


A1A6 


2599 


1862 


28A3 


1980 


Cottage Grove Hi 


1171 


1913 


1583 


932 


1AA2 


1288 


6A7 


Dallas Hi 


2229 


1221 


1102 


976 


1A98 


1101 


809 


Elmira Hi 


2116 


2081 


1306 


1967 


452 


645 


A81 


Eugene DOl 


5A23 


5A21 


5020 


557A 


2556 


A3A6 


A311 


Eugene D02 


3843 


5692 


A893 


5507 


3223 


A192 


5742 


Eugene D03 


2768 


3909 


A17A 


A9A7 


3982 


3983 


6598 



Terminal Location 


Sept 
1970 


Oct 
1970 


Nov 
1970 


Dec 
1970 


Jan 
1971 


Feb 
1971 


Mar 
1971 


Eugene D04 


4587 


4442 


4571 


3462 


4762 


3321 


8589 


Eugene lED 


1751 


1564 


1420 


1775 


1595 


2879 


2255 


Fern Ridge DO 


1936 


1642 


1173 


1147 


900 


1196 


1133 


Fern Ridge Jr 


1191 


1189 


659 


558 


543 


1033 


994 


Florence DO 


687 


1579 


1706 


1182 


1249 


1427 


985 


Hermiston DO 


1565 


2350 


2601 


1877 


1135 


1306 


892 


Hermiston Hi 


1380 


794 


514 


582 


522 


530 


823 


Hermiston Jr 


857 


1750 


1024 


461 


596 


826 


908 


Hamlin Jr 


1481 


1213 


733 


1162 


1665 


2084 


787 


Junction City DO 


925 


293 


169 


497 


45 


492 


395 


Junction City Hi 


1648 


1347 


1218 


819 


694 


1170 


707 


Junction City Jr 


1959 


1878 


2129 


829 


531 


810 


954 


Jefferson Jr 


1392 


2604 


1523 


1793 


899 


2055 


1504 


Kennedy Jr 


899 


663 


718 


808 


906 


763 


577 


Leads 1 


3575 


5903 


6131 


8649 


5656 


6830 


6615 


Leads 2 


607 


2246 


811 


3032 


2790 


316 


2075 


Leads 4 


3034 


2523 


51 


3358 


3936 


5869 


5913 


Leads 5 


3006 


1584 


3374 


2 


— 


— 


— 


Leads 6 


1008 


518 


3151 


2918 


3226 


6114 


6442 


Leads 7 


2469 


1163 


1904 


8 


2437 


— 


— 


Leads 8 


2043 


3037 


1092 


28 


3167 


— 


— 


Leads 9 


3380 


2355 


1027 


— 


— 


— 


— 


Lincoln Jr 


1032 


697 


550 


593 


572 


718 


612 


Lowell 00 


737 


1383 


868 


685 


324 


497 


496 


McEwen 


1497 


890 


1170 


969 


429 


388 


717 


McMlnnville Hi 


2792 


2605 


1977 


2001 


1468 


3572 


1796 


McMinnville Jr 


1516 


1781 


1242 


1305 


780 


1557 


1278 


McCune 


974 


2133 


1953 


1360 


474 


533 


592 


Madison Jr 


1397 


122 


814 


863 


1036 


1497 


1373 
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Terminal Location 


Sept 

1 O 7rt 

ly /U 


Oct 
1 0 7n 


Nov 

1 070 


Dec 

1 070 
X7 / u 


Jan 
1071 

X7 / X 


Feb 
1971 

A7 / A 


Mar 
1971 


Michigan Jr 


AO O 


A on 


007 
7 A / 


000 
3A7 


30U 


\JJ\J 


ORO 
33U 


Mllllcoma Jr 


OAO 

oOo 


OQO 

3o2 


3U3 


1 OA 
17*1 


OA ft 
3**0 


S9'^ 
3A3 


OOQ 
A /O 


Mllton-Freewater DO 


O *7 C Q 


o /. ra 


1 OAR 
1303 


10 0 0 
Xa A3 


901 0 


91 ft7 
AXO / 


1 OAA 
X3UU 


Monroe Jr 


1 /. 1 Q 

lAlo 


1 AAO 


01 n 

7lU 


/07 


1 1 AA 
XX*t** 


1090 
XUAU 


A 0 0 

d33 


Mapleton DO 


872 


1 0 Q1 

12oi 




300 


1 70 
X/7 


AO 7 
Hy/ 


471 


Marshfleld HI 




39 /U 


33Uo 


A /Ol 


9009 
A77 A 


OAOS 
30 7 3 


9790 
A / AU 


Marsniield Jr 


03j 


fil A 
OlO 


oon 


A03 


01 7 
3X / 




33X 


Mt Hood 


0 1 on 
2i7U 


A OCR 


00 00 


9A0 0 
AO73 


9AAA 
A*tO»* 


3uA7 


•^1 1 f> 
^XXO 


Neah-Kan-Nie DO 


24133 


1 Q/iO 


I 1 71 

II / X 


1 Q70 
XO/U 




1 9ftS 
X^03 


1462 

X*t V 


Neah-Kah-Nle Hi 


001 

Vol 


OOQ 

92o 


0 OA 
2/0 


OOQ 
AAO 


1 00 
X7U 


79A 
/ AH 


442 


Nestucca HI 


0 C C 1 

2331 


01 nn 


1 7AO 
1/07 


1 AAO 


1 91 A 
XAXO 


1 01 
XUX3 


1044 


North Eugene HI 




O AOA 

3U9o 


OnAQ 
3UOO 


1 OOO 
l3 /7 


OOOft 
A730 


907A 
A7/O 


2156 


Oakridge DO 


2/2^ 


OOQ 


1 AAO 


A/i A 


AOA 
03** 


1 1 7A 
XX/*# 


803 


Oakrldge HI 


1069 


7oo 


AOA 

ooO 


0 /. R 
743 


ROO 
392 


70O 
/2/ 


S96 

J 7 V 


OTIS CL 


A C C 

933 


A QQ 
OOO 


A OO 


A A 1 


000 
33A 




^X J 


OTIS 03 


3511 


C A OA 

3039 


O A1 O 

3019 


00 A/. 

3o04 


A RO 
03/ 


AQ1 Q 
00X0 


J70 ^ 


OTIS OA 


3S12 




30U3 


A1 HA 


A97 
0 A / 


AOA 7 


Al 71 

HX / X 


Pendleton DO 


O OA O 

329o 


O CO/. 


OAl 1 

ZUll 


1 A 00 
X039 


1 ft07 
XOU/ 


1 A1 A 
XOXO 


1 A'^O 
X03\/ 


Pendleton Hi 


1 A A C 

1903 


0 1 m 


0 A A R 


0 A R1 
A43X 


1 7ft9 
X / OA 


1 A70 
X** /U 


1 1 "^A 
XX30 


Pleasant Hill DO 


093 


/. Oft 


OA 07 
^Hy / 


000 
3A7 


000 
333 


J3U 


"^1 
33X 


Pleasant Hill Hi 


1 Q OO 


01 07 
ZIZ/ 


Afl7 
00/ 


7 RO 
/ 3A 


A 01 
03X 


37A 


S9A 
3 AH 


Pleasant Hill Jr 


Ol2 


0 07 
33/ 


0 Rfi 
230 


0 OA 

2 aU 


OAl 
24X 


0Q1 
AOX 


91 A 
AXH 


Roosevelt Jr 




D33 


303 


A70 
0 /y 


AA1 
OhX 


A1 0 
OXa 


AO 9 

07 A 


South Eugene Hi 


319U 


1 AOA 


OUO 


AOA 
4a0 


Q 0/. 
024 


QA 0 
00 i 


1 7 S9 

X / J A 


Shasta Jr 


OAO 


1 1 AH 
114U 


oon 

3AU 


1 OA R 
X7O3 


1 OOQ 
XA70 


QOO 
OA A 


11 "^9 


Sheldon Hi 


1 QO C 

lo93 


1 ni 0 
lUlZ 


A01 
091 


00 R 
393 


1 00 0 
Xa92 


000 

999 


500 


Siuslav HI 


548 














O us law Jr 


2480 


621 


1788 


1273 


302 


451 


5A7 



ERIC 



Terminal Location 


Sept 
1970 


Oct 
1970 


Nov 
1970 


Dec 
1970 


Jan 
1971 


Feb 
1971 


Mar 
1971 


opringiieia do 


D41J 


5949 


A T O O 


e /\o ^ 

5087 


O TA O 

2793 


cine 

5195 


jZ/U 


Sprlngflela HI 


2317 


4195 


H A C 

3145 


3031 


2565 


4630 


31U 


Springfield Jr 


1236 


839 


63o 


736 


667 


641 




Spencer Butte Jr 


1894 


1712 


1 f o^ 

1686 


1627 


2100 


1 £ o o 

162o 


1 /. ^ O 

140 J 


State 01 


TOO 

788 


1722 


1441 


360 


2616 


A Ton 
472U 




Thurston HI 


1954 


1522 


1591 


2116 


ol5 


O 1 c o 

215o 




Thurston Jr 


815 


2087 


1612 


695 


ft / A 

944 


1 O O A 

1234 


1 1 9A 


Tillamook lED 


94 


96 


01 A 

214 


42 




3 


999 


Tillamook DO 


2958 


2231 


2557 


3198 


2432 


166o 




Tillamook Hi 


2304 


2160 


874 


T C T 

757 


557 


1 c o o 

152c 




Triangle Lake Hi 


505 


487 


202 


417 


c/. 

54 


cm 
501 


1 AQ 


TTYSSA (OTIS) 


509 


300 


196 


1638 


5365 


T O C A 

7254 


A7AQ 


TTY33B (OTIS) 








56 


72 






Umatilla lED 


5714 


5878 


4151 


3673 


2903 


il9V 




V^illamette Hi 


3748 


1168 


1723 


1047 


1151 


Q '3 O 

o33 


oo*f 


Wlnt Hi (LCC) 


547 


2743 


909 


846 


1337 


2438 


3684 


Weston DO 


1023 


417 


444 


385 


459 


335 


282 


Westridge Jr 


204 


332 


130 


61 


105 


110 


124 


TOTAL 


195406 


196855 


164938 


155189 


129901 


182830 


169940 
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OTIS USER EVALUATION 
FOR THE SCHOOL YEAR 1969-70 



OTIS Is an educational co-*operatlve supplying a service to many 
schools in the state of Oregon. We would like you to evaluate our 
service to you and would sincerely appreciate your cooperation in 
filling In the attached optical scan sheet. The OTIS test answer 
sheet is being used to facilitate an analysis of your evaluation. 

Answer only those areas that pertain to your area of involve- 
ment of the OTIS system; do not answer areas you do not use. 

The response sheet has been precoded into district response; 
fill in the space below the number you wish to record. The back side 
of the answer sheet may be used for added comments. 



INSTRUCTIONS : 



1. There is a list of 100 areas attached to your response sheet. 
Each response area has five (5) choices. Mark only one (1) of 
the five blocks with the choice that most accurately describes 
our present service to you. 

2. It is important that each block be filled In correctly to insure 
an accurate analysis. Use this enlarged example and a #2 pencil 



to fill in each block. 




3. If more than one person is responsible for certain areas of 
application, please ask them to answer those questions pertain*- 
ing to their involvement. 

4. A stamped, self -addressed envelope is enclosed for your conven- 
ience. Please return your answer sheet to us by May 22. Thank 
you. 



SR/os 
5/6/70 



OTIS User Evaluation 

for the School Year 1969-70 
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OTIS USERS 



Evaluate each of the following Items in terms of the 
five-point scale. 

Opening of school reports for the year 1969-70: 

1. Accuracy 

2. Timely 

3* Usable in the form in which it was received 
Enrollment process: 

4. Students enrolled prior to the beginning of the school year 

5. Student verification 

6. Student body rosters 

7. Mailing labels 

8. Directories 

9. Locator cards 

Attendance process: 

10. Weekly attendance report 

11. Monthly attendance report 

12. Attendance file dump 

13. Error listing 

14. Student verification list 

15. State Quarterly report 

Scheduling process received to date: 

If scheduling is traditional: 

16. Tally reports 

17. Conflict analysis 

18. Master Schedule 

19. OTIS Manual 

20. OTIS consultant 

21. Turn-around time 

If scheduling modular ly: 

22. Input forms 

23. Verital 

24. OTIS consultant 

25. EC consultant 

26. Turn-around time 

Mark Reporting process: 

27. Grade marking sheet 

28. Report cards 

29. Failure, incompletes, no gradea«. coodltionals report 

30. Exception report 

31. Grade analysis 

32. Transcript labels 

33. Grade list 

34. Turn-around time 



OTIS User Evaluation 

for the School Year 1969-70 



-3- 



Testing process: 

35. Standardized tests 

36. Iowa 

37. CTMM 

38. SAT 

39. Test scoring only (no computer output) 

40. Teacher prepared tests 

41. Turn*around time 

Teleprocessing system: 

42. Degree of reliabilitv 

43. On-line Mastex Scneduxe i±l^ 

44. On-line student schedule file 

45. Enrollment input 

46. Attendance 

47. Mark Reporting input 

48. Inquiry capability 

Optical scan system: 

49. Attendance 

50. Scheduling 

51. Testing 

52. Mark Reporting 

Report accuracy: 

53. Enrollment 

54. Scheduling 

55. Attendance 

56. Test scoring 

57. Mark Reporting 

Timeliness of reports: 
56. Enrollment 

59. Scheduling 

60. Attendance 

61. Test scoring 

62. Mark Reporting 

Useability of report' in delivered xorm: 

63. Enrollment 

64. Scheduling 

65. Attendance 

66. Test scoring 

67. Mark Reporting 

OTIS-District structure: 

68. Coordination in your district 

69. Field service support 

70. OTIS in-house staff support 

71. OTIS publicatir«ns (memo* manuals) 

72. Coordinators* meetings 



OTIS Ustr Evaluation 

for thtt School Year 1969-70 
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Future development: (please rank order your priorities) 



5/6/70 

/OS 
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73. 


Student Problem Solving 


(1) 


74. 


QUERY 


(2) 


75. 


Computer assisted instruction 


(3) 


76. 


Inventory 


(4) 


77. 


Personnel files 


(5) 



PAYROLL and CLERKS OHLY 



Fiscal: 

81. District Coordinator 

82. Monthly Clark's meeting at OTIS 

83. Structure of Chart of Accounts 

84. Audit Trail by Fiscal reports 

85. Completeness of information available 

86. Field interface 

87. Timeliness of reports 

88. Daily edit on terminal 

89. Choice of automatic control totals 

90. Ability to locate errors 

91. Ease In understanding and use of Fiscal Systei 
Payroll: 

92. District Coordinator 

93. Monthly Clerk's meeting at OTIS 

94. Accuracy of payroll 

95. On-line time and adjustment entry 

96. Timeliness of reports 

97. Completeness of information available 

98. Field interface 

99. Ability to locate errors 

100. Ease In understanding and use of Payroll Systi 



OBBOM TOfEAL nmNMATION SYSTEM 
3S4 BMt 40th 
lug«M, Oregon 97405 



AHALT8I8 OP OTIS OSBE mumiOM 



During Hay of this year, ons Mnt approxlaately 500 rMp<mstt-typ« font 
to prlMlpalo, oocrotArlM nd OtlS eoordiiuitoro. TImi aroM of roopMoo 
n ot t t 

1. oxcellont 

2. abovo avorage 

3. aatiafactory 

4. balov avaraga 
5 • unaatiaf actory 

Tbay ara groupad togathar by parcaatagaa^ l«-2 rapraaaata abova avaraga, 
3 avaraga* and 4*5 balov avaraga. Of tha 500 forM, 262 ara rapraaantad 
bora. 



X ABOVE X X BELOW 

CBOOPED ITEMS AVEBACE A?EBACB AVEBACE 



1- 


3 


opbnihg op school upoits 


23.8 


40.8 


35. 


.2 


4- 


9 


BNROLLMBNT PBOCBSS 


36.5 


41.9 


21. 


.4 


10- 


15 


ATTERDlAHCE PROCESS 


45.4 


39.6 


14. 


.9 


16- 


21 


SCHEDULUIG PR0CI8S UdlVD TO OAIB 


55.6 


35.4 


8. 


.9 


22- 


26 


IP 8CBEDIILIII6 MODULAILT 


35.5 


57.6 


6. 


7 


27- 


34 


MASK UPORnUG PBOCBSS 


61.1 


30.2 


8. 


.6 


35- 


41 


TBSTIMC PROCESS 


61.7 


29.0 


9. 


.2 


42- 


45 


TBLEPBOCBSSZMG STSTBf 


51.4 


37.3 


11. 


.2 


46- 


48 


ATTENDANCE 


61.4 


32.2 


6. 


.3 


49- 


52 


OPTICAL SCAM 8TSTBM 


50.8 


37.2 


11. 


.9 


53- 


57 


REPORT ACCURACT 


55.5 


34.9 


9. 


.4 


56- 


62 


TIMBLimSS OP REPORTS 


39.9 


43.9 


16. 


1 


63- 


67 


USEABIUTT OP REPORTS 


51.7 


38.0 


10. 


.1 


66- 
* 


72 


OTIS-DISTRICI 8TRUCIURB 


48.6 


38.5 


12. 


.7 


81- 


91 


PISCAL 


37.1 


46.1 


16. 


7 


92-100 


PAYROLL 


56.7 


36.4 


6. 


7 



*73*77 FUTUBB DEVELOPMENTS (rankad in ordar of priority): 





All 




Coordinator* 


1. 


Query 


1. 




2. 


Invmtory 


2. 


Student Problaa Solving 


3. 


Studmt Probln Solvlnt 


3. 


Iav«atovy 


4. 


P«rsonn«l Pile* 


4. 


Coaputor Ataintod Instruction 


5. 


Cosputcr Assisted Instruction 


5. 


Psrsooanl 



o 
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AMlyais of OTIS U»er Evmluatlon 
June 23 » 1970 
Page 2 



*73-77 FUTURE DEVELOPMENTS (cootlnuad) 

Prlnclpala-"8acoodary 

1. Coaputar Aaaiatad Inatruction 

2. StydMt Ptoklaa Solvlat 
3» Invantory 

4. Paraonaal 

5. Quary 

Sacratarlas'^Sacondary 

1. Query 

2. Covputer Aaalated Inatruction 

3. Student Problem Solving 



Pr inclpala-^Eleaentar y 

1. Inventory 

2. Query 

3. Peraonnel 

4. Student Problem Solving 

5. Computer Aaalated Inatruction 

Secretarlea-^Eleaentary 

1. Inventory 

2. Peraonnel 

3« Student Problcn Solving 

4. Query 

5. Coa^uter Aaalated Inatruction 



Tie- Inventory & Peraonnel 



8R/oa 
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OREGON TOTAL INFOBMATION SYSTEM 
354 EAST 40TH AVENUE 
EDGENE, OREGON 97405 
February 15, 1971 



OTIS OOTSTIONNAIRB 



lo order to evaluate the reeulta of the OTIS Title Project the 
follovlng questionnaire haa been developed to survey uaer opin* 
ions of how well OTIS has achieved its stated objectives. The 
results of this and other data gathering procedures will go to 
■ake up a final evaluation of the OTIS project to be available 
not only to Federal and State agencies but to the public as 
well. Obviously ve are most desirous of having a high percent* 
age of returned questionnaires accurately portraying user 
opinions. 

An OTIS test sheet is attached for use as your answer sheet. 
Note that you question numbers begin with 1 and end with 44. 
Please mark only those questions indicated on the questionnaire, 
however, you may use the back of the answer sheet for comments. 
We would welcome such comments especially concerning questions 
40 through 44. Individual schools and districts will not be 
cited. Our results will be consolidated into percentages of 
total respondents only. 

Instructions: 

1. Each numbered response has five selections available to it 
nu^ered one (1) through (5). nark only one of the five 
choices with your opinion reflecting the choice you consider 
closest to representing the service of your school. Be sure 
to fill in the selected block completely with a No. 2 pencil. 

2. Please consult with fellow employees in areas with which they 
may be better acquainted than yourself. We hope to achieve 
responses that most accurately reflect school personnel opinions. 

3. Please disregard those statements which apply to services not 

utilised by your school. 

4. A stamped, 8elf"*addre8sed envelope is enclosed for your conven- 
ience. 



NDR/wm 



OREGON TOTiUL INIOBUTION SYSTEM 
354 EAST 40TH AVENUE 
EUGENE» OREGON 97405 



OTIS QDESTIONNAIRE 



Selections available represent the follovlng: 

1 - excellent 2 ■ good or above 3 ■ average or 

average satisfactory 

4 ■ poor or belov 5 ■ unsatisfactory 

average or unacceptable 



Enrollaent Process 

1 Base of enrollment of new students and updating of enrollaent records 

2 Accuracy of enrollment of new students and updating of enrollment records 

3 Usefulness of output reports (student verification* student body rosters » 
mailing labels » directories* locator cards) 

4 OTIS manual 



Attendance Process 

5 Ease of attendance data gathering system 

6 Accuracy of attendance flies 

7 Usefulness of output reports (weekly and monthly attendance reports » 
error lis tings » state quarterly report) 

6 OTIS manual 



Scheduling Process 

If scheduling traditionally : 
9 Usefulness of preschedullng reports (edit and tally reports, 
conflict analysis) 

10 OTIS consultants and field service 

11 Turn around time 

12 OTIS manual 

If Scheduling modularly ; 

13 Input forms 

14 OTIS consultants 

15 OTIS manual 

IS Turn around time 



Mark Reporting Process 

17 Grade marking sheet 

18 Turn around time 

19 Output reports (report cards, FINC list, grade analysis, labels) 

20 OTIS manual 



Test Scoring 
21 Standardised test preprinted answer sheets 
.22 Turn around time 

23 Usefulness of output reports (labels, test snalysls) 



^RIC 24 Teacher made tests 

ms^m 25 OTIS manual 



2- 



TelcproceaelM SygtM 

26 EtllablUty 

27 Speed 

28 Accuracy 

29 Ons aanuel 



OTIS Reports 

30 Delivery 

31 Accuracy 

32 Usefulneea 



QUERY 

33 Online ttode 

34 Over night aode 



Coordination Structure 

35 District Coordinator 

36 OTIS Field Service 

37 OTIS Coordinator Heetlngs 

38 OTIS publications 

39 OTIS In-house staff support 

The following are those services to schools presently considered online 
(Input by teleprocessing) by OTIS. We would like your opinion of their 
worth as online systems rather than as batch systeas. Mark each from 
one (1) to five (5) according to how you eee their worth to your school 
not as a separate system but as an online system rather than aa a batch 
system. In other words the further you move toward unsatisfactory (S) 
the closer you move toward batch system. 

40 Enrollment 

41 Attendance 

42 Scheduling 

The following are those services to schools presently considered batch 
(Input by forms to OTIS) by OTIS. We would like your opinion of their 
worth as batch systems rather than online. Mark each from one (1) to 
five (5) according to how you see their worth to your school not as a 
separate system but as a batch system. In other words the closer you 
move to unsatla factory (5) the closer you move toward an online systsm. 

43 Grade reporting 

44 Testing 



ERIC 
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OREGON TOTAL INFORMATION SYSTEM 
354 EAST 40TH AVENUE 
EUGENE, OREGON 97405 
February 15, 1971 



CLERK QUESTIONNAIRE 



In order to evaluate the results of the OTIS Title Project the 
following questionnaire has been developed to survey user opin- 
ions of how well OTIS has achieved its stated objectives. The 
results of this and other data gathering procedures will go to 
make up a final evaluation of the OTIS project to be available 
not only to Federal and State agencies but to the public as well. 
Obviously we are iDOSt desirous of having a high percentage of 
returned questionnaires accurately portraying \iser opinions. 

An OTIS test sheet is attached for use as your answer sheet. 
Note that your question numbers begin with 50 and end with 66 . 
Individual district responses will not be cited. Our results 
will be consolidated into percentage of total respondents only. 

Instructions; 

1. Each numbered response has five choices available to it. 
Mark only one (1) of the five choices available with the 
choice that you consider most closely reflects the service 
to your district. Be sure to fill in the selected block 
completely using a No. 2 pencil. 

2. Please consult with fellow employees in areas with which 
they may be more familiar than yourself. We hope to 
achieve responses that most accurately reflect district 
personnel opinion. 

3. Please disregard questions concerning services not 
presently utilized by your district. 

4. A stamped, self-addressed envelope is enclosed for your 
convenience . 
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CLERK QUESTIONNAIRE 



Selections available represent the following: 



1 



excellent 



2 ■ good or above 
average 



3 ■ average or 
satisfactory 



4 « poor or below 
average 



5 " unsatisfactory or 
unacceptable 



Reports 

50 Accuracy 

51 Timeliness 

52 Audit trails 

53 Structure of chart of accounts 

54 Payroll checks 



Teleprocessing 

55 Payroll time and adjustment entries 

56 On-line fiscal batch transactions 

57 Dally edit reports 

58 Online Query 



Coordination Structure 

59 District Coordinator 

iO Monthly Clerk's meeting 

61 OTIS field service 

62 OTIS In-house staff support 

63 OTIS manual 

64 OTIS publications 



Both the Fiscal and Payroll services are considered on-line systems 
(Information Is entered by teleprocessing methods). We would like 
your opinion of them as on-line systems In comparison to batch systems 
(In a batch system Information Is gathered and forwarded to OTIS on 
forms). Mark each from one (1) to five (5) according to how you see 
their worth to your district not as a separate system but as an on-line 
system. In other words the closer you move toward unsatisfactory (5) 
the closer you move toward a batch system. Feel free to make any comments 
you wish to on the back of the questionnaire on any aspect of the project 
but especially on your opinion of the on-line status of fiscal and payroll. 



65 On-line Fiscal system 

66 On-line Payroll system 



NDR/wm 
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ANALYSIS OF OTIS USER EVALUATION 



213 Responses to 243 Questionnaires (87%) 



OTIS Questionnaire 







1 


z 


Q 
J 




c 
O 




Enrollment Process 












1. 


Ease of enrollment 


.32 


.39 


.27 


.02 





2. 


Accuracy of enrollment 


.31 


.42 


.24 


.03 





3. 


Usefulness of output reports 


.27 


.37 


.29 


.07 





A. 


OTIS manual 


.13 


.41 


.37 


.07 


.02 




Attendance Process 












5. 


Ease of attendance data gathering system 


.28 


.40 


.31 


.01 





6. 


Accuracy of attendance files 


.4;:. 


.35 


.24 








7. 


Usefulness of output reports 


.31 


.39 


.22 


.07 





8. 


OTIS manual 


.15 


.36 


.38 


.10 


.01 




Scheduling Process 














If scheduling traditionally: 












9. 


Usefulness of prescheduling reports 


.33 


.39 


.20 


.06 


.01 


10. 


OTIS consultants and field service 


.23 


.40 


.31 


.03 


.03 


J. J. • 


lurn aruunu cime 












12. 


OTIS manual 


.17 


.36 


.41 


.07 







If scheduling modular ly: 












13. 


Input forms 


.29 


.41 


.24 


.05 





14. 


OTIS consultants 


.29 


.47 


.24 








15. 


OTIS manual 


.19 


.38 


.44 









Turn around time 


. zz 


. ZO 


. jy 


. 11 






Mark Reporting Process 












17. 


Grade marking sheet 


.27 


.51 


.21 


.01 





18. 


Turn around time 


.31 


.42 


.22 


.05 





19. 


Output reports 


.31 


.34 


.27 


.06 


.01 


20. 


OTIS manual 


.22 


.38 


.33 


.07 






Test Scoring 












21. 


Standardized test answer sheets 


.36 


.39 


.18 


.05 




22. 


Turn around time^ 


.11 


.41 


.37 


.08 




23. 


Usefulness of output reports 


.22 


.47 


.21 


.08 


.01 


24. 


Teacher made tests 


.28 


.33 


.30 


.08 




25. 


OTIS manual 


.13 


.46 


.31 


.07 


.03 




Teleprocessing System 












26. 


Reliability 


.20 


.41 


.35 


.03 




27. 


Speed 


.24 


.39 


.29 


.08 




28. 


Accuracy 


.28 


.47 


.24 






29. 


OTIS manual 


.21 


.36 


.40 


.03 
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1 


2 


3 


4 


5 


OTIS Reports 












30. Delivery 


.16 


.43 


.34 


.05 


.02 


31. Accuracy 


.30 


.48 


.19 


.03 





32. Usefulness 


.22 


.49 


.22 


.06 


.01 


QUERY 












33. Online mode 


. 19 


. 36 


.40 


.06 




34 . Over night mode 


. 18 


.33 


.43 


.05 


.02 


Coordination Structure 












35. District Coordinator 


.50 


.28 


.20 


.02 





36. OTIS Field Service 


.17 


.36 


.38 


.07 


.02 


37. OTIS Coordinator Meetings 


.10 


.32 


.45 


.10 


.03 


38. OTIS publications 


.13 


.28 


.46 


.11 


.02 


39. OTIS in-house staff support 


.17 


.49 


.25 


.07 


.01 


40. Enrollment online 


.48 


.32 


.16 


.01 




41. Attendance online 


.51 


.32 


.12 


.02 




42. Scheduling online 


.36 


.36 


.21 


.06 





43. Grade reporting batch 


.32 


.37 


.19 


.08 


.05 


44. Testing batch 


.24 


.38 


.26 


.04 


.08 


GROUPED ITEMS 












1- 4 Enrollment 


. 26 


. 40 


. 2y 


• \JD 




5- 8 Attendance 


. 29 


• 38 


.28 


.04 




9-12 Scheduling (3S) 


. 21 


. 39 


• Jz 


nz 
. Oo 


m 
. Ui 


13-16 Scheduling (Mod) 


.25 


.38 


.32 


.04 




17-20 Mark Reporting 


.28 


.41 


.26 


.05 




21-25 Test Scoring 


. z z 


/i 0 
. HZ 


. Z / 


. u / 


« uz 


26-29 Teleprocessing 


.24 


.41 


.32 


.04 




30-32 OTIS Reports 


.22 


.47 


.25 


.05 


.01 


33-34 QUERY 


.18 


.34 


.41 


.05 


.01 


35-39 Coordination 


.24 


.34 


.34 


.07 


.02 


1-39 Student Services 


.25 


.40 


.29 


.05 


.01 



o 
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Clerk's Questionnaire 







1 


2 


3 


4 


5 




Reports 












50. 


Accuracy 


.40 


. 52 


. 04 


• 04 




51. 


Timeliness 


.30 


.50 


.15 


.04 




52. 


Audit trails 


.26 


.33 


.40 








53. 


Structure of chart of accounts 


.47 


.41 


.12 


— — _ 




54. 


Payroll checks 


.54 


.31 


.15 




— — — 




Teleprocessing 












55. 


Payroll time and adjustment entries 


.48 


.40 


.12 


— 


— — — 


56. 


Online fiscal batch transactions 


.53 


.40 


.07 






57 . 


Dai 1 V edit retiorts 


.36 


.45 


.09 


.09 




58. 


Online Query 


.29 


.36 


.36 









Coordination Structure 












59 . 


District Coordinator 


.35 


.45 


.15 


.05 




60. 


Monthly Clerk's meeting 


.25 


.50 


.19 




.06 


61. 


OTIS field service 


.21 


.58 


.13 


.08 




62. 


OTIS in— house staff sunnort 


.48 


.35 


.09 


.09 




63. 


OTIS manual 


.16 


.48 


.28 


.08 





64. 


OTIS publications 


.09 


.65 


.22 


.04 




65. 


Online Fiscal system 


.40 


.50 


.10 






66. 


Online Payroll system 


.56 


.38 


.06 








GROUPED ITEMS 












50- 


54 Reports 


.40 


.42 


.16 


.02 




55- 


58 Teleprocessing 


.43 


.40 


.15 


.01 




59- 


64 Coordination 


.25 


.50 


.18 


.06 




50- 


64 Business Services 


.34 


.45 


.16 


• 04 


— — ~ 




OTIS Manual 












4. 


Enrollment 


.13 


.41 


.37 


.07 


.02 


8. 


Attendance 


.15 


.36 


.38 


.10 


.01 


12. 


Scheduling - Traditional 


.17 


.36 


.41 


.07 




15. 


Scheduling - Modular 


.19 


.38 


.44 






20. 


Mark Reporting 


.22 


.38 


.33 


.07 




25. 


Test Scaring 


.13 


.46 


.31 


.07 


.03 


29. 


Teleprocessing System 


.21 


.36 


.40 


.03 




63. 


Coordination Structure 


.16 


.48 


.28 


.08 






Total 


.19 


.39 


.37 


.06 
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SUMMARY OF EVALUATION 



Based on the summarization of the OTIS questionnaire some 
general conclusions seem evident. 

1. For the 1971 questionnaire no user reported more than 
03% as unsatisfactory and In most Instances there were 
no unsatisfactory responses. 

2. Grouping the responses Into the areas of student services 
and business services, the users rate these services as: 
Student Services 

25% excellent, 40% good or above average, and 29% average. 
Business Services 

34% excellent, 45% good or above average, and 16% average. 

3. Those activities rated lowest were the area of communica- 
tion between OTIS and the user; specifically coordination 
meetings and manuals. The users seem to have great con- 
fidence In the programs as well as the teleprocessing 
system. 

4. Comparison of the latest evaluation with the previous 
evaluation (June 1970) shows a considerable shift toward 
a more successful operation. The following Is a percent 
comparison of user responses on some common areas. 



Above Average " 1 and 2, Average ■ 3, Below Average 4 and 5. 



GROUPED ITEMS 


% Above 
Averase 


1970 

X 

Average 


X Below 
Average 


X Above 
Average 


1971 
X 

Average 


X Below 
Average 


Enrollment 


36 


.5 


A1.9 


21. A 


66 


29 


05 


Attendance 


45 


• A 




1 /. O 


b 1 


Zo 




Mark Reporting 


61 


.1 


30.2 


8.6 


69 


26 


05 


Testing 


61 


.7 


29.0 


9.2 


6A 


27 


09 


Teleprocessing 


51 


• A 


37.3 


11.2 


65 


32 


OA 


Fiscal 


37 


.1 


A6.1 


16.7 








Payroll 


56 


.7 


36. A 


6.7 








Business Services 










79 


16 


OA 
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910 STANDARD PLAZA 
PORTLAND, OREQON 97204 



June 4, 1969 



Dr. Dale Pamell 

Siqperintendent of Public Instruction 
Salem, Oregon 



Dear Dr. Pamell: 



This letter documents the review of Project OTIS (Oregon Total Information 
System) conducted by Touche, Ross, Bailey § Stoiart. The review was performed 
at the request of the Oregon State Department of Education, and was conducted 
between May 5 and June 3, 1969. 

The Oregon State Department of Education required this evaluation to assist 
it in the review of OTIS*s 1969-70 budget. Touche-Ross was provided twelve 
questions around which to structure its review. In the process of answering 
these questions, we developed certain reccnmendations for your consideration. 
We wish to enqphasize, however, that specific answers to these questions and 
our reccnmendations should not be read out of the context of this report. 
Extremely significant background material is contained in the early part of 
this report and must be considered by the reader as he interprets our con- 
clusions. 

The report is structured into the following sections: 



I . APPRQ/^CH 

Our evaluation was conducted in two phases: 

A. A review of the ccnputer facility with specific en9)hasis on the 
technical integrity of the systems design and applications. We 
also examined the degree of computer hardware utilization and the 
technical competence of the OTIS staff. 

B. A separate study was made of OTIS^s objectives and performance. 

The second phase began with a review of the OTIS proposals and literature, 
coiq[)led with interviews of key OTIS and Lane County lED personnel. The result 



I. 
II. 
III. 
IV 



Approach 

Definition of OTIS 
Response to Questions 
Conclusions and Recommendations 
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was an accurate definition of v^t OTIS is and \A\at its current objectives 
are. Measuring the level of achievement toward these objectives became the 
major task of this phase. 

An interviewers* discussion guide was prepared to assist in evaluating 
the intact of OTIS on the educational comrnmity. Personal interviews were 
conducted with current users and non-users. Ihe interviews tried to identify 
the iii^ressions and experiences of all levels of users. Similar interviews 
were conducted with non-users to identify their understanding of OTIS and 
their reasons for not being in the system. Additional interviews were held 
with Parkrose and Corvallis to see v^y they are leaving the OTIS system. 
Tliese activities resulted in more than forty interviews throughout the Wil- 
lamette Valley. 



II. DEFINITION OF OTIS 

It is inappropriate to comnent on OTIS before first establishing what it 
is. yh are confident that both a lack of understanding and misinformation 
exist to the extent that few can properly describe it. Ihe sources of this 
condition are considered in the following pages of this report. 

OTIS is a conq>uter resources center. While it is a component of the Lane 
County Intermediate Education District, it can perform computer processing 
for non-Lane County locations. Its worth as a computer center rests on three 
factors : 

A. As a part of an educational organization, it can be more understanding 
of and responsive to the Oregon educational community's requirements. 

B. By developing a Generalized Educational Management System (GB1S), it 
can respond to the various changing requirements of present users 
and those of the future on an individual basis. 

C. By using a teleprocessing environment (a network of telephone lines 
and teminals connected to the corq;>uter) , OTIS can assure the accur- 
acy and timeliness of data entered for processing and the timeliness 
of response for processed data returned to the user. 

Of the three factors, the second is the one least understood. 

The traditional approach to using a computer for information processing 
is to develop specific systems for specific requiremmts. For exan^le, within 
a payroll system there would be designed the capability of producing paychecks, 
cost distribution reports, etc. Ihe progranming and infoimation to be pro- 
cessed would be tailored to \ihat this particular system needed . There could 
be» and commonly are, many elements of a specific system that would be of 
interest to other applications. For example, the personnel data associated 
with payroll preparation may also be that associated with district certifi- 
cation and staffing requirements. The result of this overlapping requirement 
is manifest in several ways, the most inqportant of i^ich is the repreparation 
and recapturing of data for each ai^lication. The first level of reaction to 
this problem is the establishment of another specific system that can perform 
the required fiinctions of the first two. 
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In the instance of our exanple, a district personnel records system would 
be developed from v/hich the payroll and staff scheduling systans could draw 
upon the basic personnel data for their unique or common requirements. Because 
we can't see the future, we continue to resystematize and reprogram past good 
work to acccfnnodate efficient processing. 

Recall that the point of contention is around the data being entered for 

Erocessing. When it is specifically tailored for a system^ the chance of 
aving to re-enter it ^hen it is needed by another system is very high. 
Similarly 9 data processed in one system may not be readily available to a 
second system and will have to be manually captured and re-entered for pro* 
cessing requirements. Planning can and does mitigate this problem considerably. 
However, two factors relating to system development seriously qualify the 
benefits of planning. They are: 

A. A multiplicity of users, each with a basic informational requirement, 
exercising their need for variations within that basic requirement. 

B. A dynamic educational environment in vduch change is the expected 
constant • 

When these variables are present, a second level of reaction to our pro- 
blems is appropriate. This calls for the development of a more generalized 
rather than specific system capability, i/i effect, the tailoring of data is 
eliminated at entry time. Hie computer is told all we know without qualifying 
that knowledge by how it is to be used. Similarly, processed data can be 
retained in this generalized fonn for further informational requirements. 
Data items are extracted from this base of knowledge through specific appli- 
cation programs. Given the variables earlier referenced, this system level 
has a favorable inq>act on the economies of computing by eliminating much of 
the duplication and rework problems in a specific system environment. To 
this point, the facility is catering to the data entry aspect of data proces- 
sing. What of the output of processed data? 

The largest class of information requirements are specific questions and 
answers. Who are the students absent with the greatest frequency? Who are 
the teachers with a specific academic background? Answering these questions 
has classically depended on two factors: 

A. We expect a specific question to be asked and program a report 
v^ich could answer it. 

B. We develop a report containing all possible answers to our questions 
i^ich must be manually reviewed to conpile a specific question and 
answer. 

Because these concepts can be so ably handled by the computer, the third 
level of system design came into being. This level accepts specific ques- 
tions and provides specific answers. The user has the fastest optimum res- 
ponse because the information he is receiving is that which is most current 
and no manual review or cQn;)ilation has to be conducted. Again, the economics 
of confuting are facilitated as much programning is eliminated in favor of 
the users being able to tell the conputer vAiat he specifically wants to know. 
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Three Levels of Systems Approaches 




Amount of Resystematization and 
Reprogramming 



The above figure sunvnarizes the relationship of the three system approaches 
There are few vAio cannot see the desirability in advancing to the third level 
of system status. Among those \A\o could were the authors of the OTIS proposal. 
This is exactly the goal they have established for themselves. The data pro- 
cessing environment they wish for and are working for in the State of Oregon 
educational conmunity is one in vdiich the "utility" concept of a processing 
center achieves its highest meaning. Like the switching network of a telephone 
ccnp&tiy's central offices, vAiose general capability is to transmit messages, 
the general capability of OTIS will be to store and present data as required 
by individual users across the state. 

If this is not the OTIS you know, we are not surprised. Some historical 
notes may explain why this is so. We judge a thing by its action. OTIS found 
it necessary to develop and offer certain specific systems at the earlier 
defined second level of system status in order to provide some early benefits 
to its users. Remember the characteristics of that level were largely balanced 
in favor of the data entry side of the system rather than the direct question 
and answer aiphasis. This created an image similar to other existing educa- 
tional systems in the state, in spite of OTIS's unique third level systems 
approach. Early specific applications systems were the necessary catalyst 
in gaining initial support for the OTIS operation. The OTIS concept, fully 
develq)ed and exercised at the third systans level, would eliminate much of 
the now existent reporting in favor of specific inouiries and answers. 
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It is not our purpose to pass judgment on this earlier period. Like many 
projects in vAiich there is a strong research and development requirement, 
miscalculation of potential start-up problems and beginning workloads is ex- 
pected. This approach to obtaining early support in the face of critical 
in^lementation problems is not uncomnon. 

We sketch this picture of OTIS because it is this OTIS we are evaluating, 
not the OTIS image that is in so many Oregon educators' minds. We reference 
t:he direction OTIS has taken not as an endorsement of it, but an acknowledge- 
ment of their action. 



III. RESPONSE TO QUESTIONS 

An observation is appropriate and mcdr.ingful. OTIS's objectives are 
exemplary and innovative, but subjective. It became evident early in the user 
interviews that measurement of how OTIS was fulfilling its stated objectives 
(as listed in Volume I of the Title III grant application documents) could 
not be quantitative. Users could only respond with personal value judgments 
vlhen we asked them about the extent of OTIS's objective fulfillment. 

Thus, in viewing OTIS's achievement of these objectives we are only able 
to record: 

A. Whether or not effective effort has been exerted tcfward an objective. 

B. The users' sublective judgments as to how near OTIS has come to an 
objective's achievement. 

How well is OTIS doing in meeting these objectives? ((^lestion 5) To 
answer this question, we have listed each of the specific objectives and our 
findings . 

Objective No> 1 - To improve educational opportunities for etudente by 
building a total information eyatem which will aid in the individuali- 
zation of inetruction as well as providing improved administrative 
information. 

The following conments on the other objectives best indicate how well 
this objective is being met. 



Objective No* 2 - To create a data bank coneieting of five areae of infer- 
motion (etudent^ staffs curriculum^ property , finance) which will: 

a. eupport the informational needa of all peraona engaged in the educa- 
tional proceaa. 

b. aerve aa a baaia for research^ evaluation^ and planning. 

c. provide a foundation for future applicationa of computera to educa- 
tion. 

Progress has been made toward establishing a data bank in all of the 
five designated areas of information: student, staff, curriculum. 
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property, finance. The most undeveloped area is the property data base. 
The systems design work is ccinpleted, and programming has begun. Never- 
theless, the beginning of a data base to support the informational needs 
of OTIS's users has been established. The full ability to utilize this 
data base for planning, evaluation and research functions is not yet 
implemented. OTIS is conmitted to providing this capability through the 
development of "Query". These software routines are targeted for inple- 
mentation before September, or the beginning of the 1969-70 school year. 
OTIS at that time should be well on its way to providing a foundation for 
future computer applications in education. 



Objective No. 3 - To demonstrate a geneTalized Qomguter eyetem which will: 

a. prooeee a great variety of applicatione under a eingle prograrrmed 
control eyetem. 

b. have analytical capabilitiee for comparing, correlating^ manipulating, 
and eurmarizing the information etored in the data bank. 

c. provide for eyetem expaneion and revieion without deprogramming. 

d. produce printed reporte according to dietrict epecificatione on a 
eurrmary or detailed level or by exception. 

In developing the Generalized Education Management System (GEMS) soft- 
ware package, OTIS will have a generalized computer system that processes 
a variety of applications. However, they have yet to in5)lement a program 
control system that will provide analytical capabilities for comparing, 
correlating, maniuplating, and summarizing information stored in the data 
bank. GEMS will have the capability for system expansion and modification 
with very little reprograraming . With the in?)lementation of "Query" in 
September, users should be able to produce printed reports according to 
district specifications on a summary, detailed or exception level. 



Objective No. 4 - To build a telecommunicatione network linking participating 
ecnoole to one large computer in order to: 

a. maintain data in a current etatue. 

b. make poeeible rapid acceee to eelected data. 

c. provide computing power to echoole of all eizee. 

d. aeeure reaeonable individual dietrict coete. 

e. provide etudente with the opportunity to learn computer techniques 
and programing in their local environment. 

OTIS has begun to build a telecommunications network that maintains 
data in current status. Access to the data bank information is more 
rapid than conventional batch systems, but slower than other teleprocessing 
information retrieval systems. Current terminal response was poor due 
to a combination of inplementation problems and the lack of user familiarity 
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with teleprocessing terminal procedures. OTIS has the potential to provide 
computing power to schools o£ all sizes, but is limited by economic feasi- 
bility in adding low volume teminals m the smaller, rural districts. 
Reasonable individual district costs are not assured. Most users felt 
the per student costs were high. Our conclusions with regard to costs 
are outlined on page 9 of this report. 

Hie opportunities for students to learn programming and computer tech- 
niques are present in OTIS's operation, but have not been emphasized to the 
degree that is possible and beneficial to the student users. Some instruc- 
tional activity has gone on, but our user interviews indicated a great need 
for more effort in the student problem solving and computer instruction 
areas . 



Objective No> 5 - To eetablieh a coordination eyetem ooneieting of OTIS 
field repreeentativee and aohool district coordinators which will: 

a. facilitate commnication between educators and data processors* 

provide for smooth operation through continuing system evaluation. 

c* provide for in-service training for school personnel in general data 
processing concepts as well as specific system procedures. 

OTIS's coordination system (consisting of field or school represen- 
tatives and district coordinators) provides the means to facilitate com- 
immication between educators and data processing personnel. However, 
this essential system often fails due to the lack of well planned, con- 
sistent leadership at OTIS's management level. According to the inter- 
viewed users, few of their requests for systems modifications were given 
effective attention. As a result, there are inaccuracies and weaknesses 
in OTIS's own system evaluation efforts. For the same reasons (poor 
communication and coordination) there has not been enough well planned 
in-service training for school personnel in data processing and systems 
procedures . 



Objective No. 6 - To implement^ evaluate^ and refine the total informal 
tion system designed during the Project OTIS planning phase. 

The implementation and refinement of the 'Total Infomation System" 
designed Airing OTIS*s planning phase is still going on. Little real 
evaluation has been achieved internally because of the weaknesses in OTIS's 
coordination system. The systems and software implementation to date has 
been behind schedule for plausible reasons (delayed system delivery, com- 
plicated testing requirements, etc.). 



Questions 6 and 12 relate to the user and non-user evaluations of OTIS's 
services. From our interviews, the following is summarized: 
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A. Users 

Enrollment - The format and promptness of response were sat is - 
factory in 951 of the cases. Accuracy was acceptable in all but one 
case. In that case, an elementary school had so many difficulties 
that they became alienated with OTIS. 

Attendance - 

1. Attendance reports were inadequate for most elanentary 
schools. The format provided breakdown by grade, not 
class, and all schools queried stated teachers completed 
and maintained their own attendance, while school secre- 
taries coirpiled results on the OTIS form, thus di;plica- 
ting effort and causing redundant paperwork. 

2. Similar problems were encoiontered at the high schools, 
in that all but one still require attendance by period, 
vAiile OTIS will only report attendance by day and half- 
day. The result is duplicate records are again being 
compiled. 

Report Cards - Applicable only to secondary schools. Format, 
accuracy, and promptness are very satisfactory. 

Scheduling - Applicable only to secondary schools. Format and 
promptness were acceptable, but accuracy at the teacher level was 
inadequate in over half of the cases interviewed. 

Testing - Test scoring as offered was well done. At pres.iit, 
only three tests are scored at OTIS. Expanded activity in this area 
is needed. 

B. Non-Users 

Non-users generally did not recognize the extent of current OTIS 
services nor did they believe that OTIS will achieve what they promise 
for the 1969-70 school year. Only two of the second wave districts 
plan to participate in the program. 



OTIS's organization (Question 7) has just been altered. As structured, 
it can perfonn liaison and developmental work in an effective manner. More- 
over, the key positions (Question 8) are staffed with above aven ifi to excep- 
tional personnel. This was true of all the OTIS staff members interviewed i4iile 
conducting this evaliaation. There is a planned expansion to full exploitation 
of installed hardware (Question 9) . The shortcmings in software (Question 10) 
are primarily associable witJi the size and efficiency of the programs. User-written 
programs are being recoded to gamer improved efficiency. IBM*s operating 
system has been used intact, an approach we highly endorse, and is being con- 
sistently inproved by the manufacturer. OTIS has received all of the assistance 
it has requested from IBM (Question 11) . 

The Parkrose pull-out (Question 4) was primarily attributable to that 
O district's participation in the Multnomah County lED data processing program. 
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As its involvement with its own lED was mandatory, and as Parkrose could not 
justify continued duplicate expense, it withdrew from OTIS. 

The economic question (Question 3) is one that has been confused by OTlS's 
failure to communicate its objectives. If OTIS is evaluated as a preparer of 
reports vAich are analagous to those prepared by other less expensive approaches, 
then its costs are almost twice what they should be. However, that is not what 
OTIS is. As we have explained, OTIS's operation of GEMS should have an impact 
on the total costs of data processing by eliminating much of the expense assoc- 
iated with resystemization and reprogramming . A greater expense is incurred 
in implementing a "third level" or generalized system. The expense can be 
recovered during the operating life of the system because of its adaptability 
to changing infomation requirements. We cannot predict the economic worth of 
that capability. Similarly, we cannot predict the worth of the infonnation 
potential of the integrated > responsive data base that is offered by OTIS. 
We can say that the ingredients for a large pay off exist because of the multi- 
plicity of infonnation processing requirements represented by so many potential 
users > each with individual constraints and reporting requirements. In addition, 
the education ccHnmunity with all of society is in revolution, so the ingredient 
of expected change is constant. In our opinion, OTIS is creating the standard 
by vdiich Generalized Education Systems will be measured. There is no apparent 
tested standard in existence. 

Question 2 references OTIS's relationship to quality and economic educa- 
tion in Oregon. Financing education in Oregon is a sensitive political problem. 
While there may be several actions needed to solve this problem, one way must 
certainly be to achieve public confidence in the financial managanent of the 
school system. The AOI report indicates a number of better business practices 
that education should consider. Improving a condition obviously depends on 
sufficient information about it. A thorough and adequate analysis of the edu- 
cation system of our state, unfortunately, depends on data that is both partial 
and fragmented. An expanded use of data processing can improve this infonnation 
position to the degree that confidence can be placed in the statements of require 
ments to fulfill educational objectives. This confidence can be conveyed to 
the people. In that light OTIS possesses exceptional potential for reviewing 
the resources existent and requirea in the educational community. 

There begins to emerge in the answers to these questions a definite pattern. 
The OTIS product (GBIS) is well developed. iTae OTIS services are not, which 
identifies OTIS's primary weakness. It has failed to communicate with those 
it would service. We indicated earlier that in the development of its product 
OTIS found it necessary to prepare specific reports. These have become the 
measurements of OTIS. OTIS has failed to canmunicate what its proper measure- 
ment should be. 

Any data processing system is only as valuable as it is useful, and it is 
only useful to the extent its clients understand it. There is little in the 
professional development of an educator that prepares him to use the full capa- 
bilities of OTIS. There has been no successful attempt in conveying OTIS*s 
potential to educators. There is no assurance that the education community 
can use OTIS's potential and, therefore, there is a serious question as to 
vAiether it should pay for it. The best way technically may not be the best 
way actually. We will deal with this issue further as a component of the 
answer to Question 1. 
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IV, CONCLUSIONS AND RECCM^ENDATIQNS 

"From every measurable point o£ view, is OTIS worthy of continuation and 
expansion?'* (Question 1) From a tecnnical viewpoint, OTIS is a worthy venture. 
They are working to meet their objectives and will be successful in developing 
their product. But a product is not a service unless it is converted to be so. 
OTIS has failed to successfully convert its product into a service. If it is 
to continue to exist, it must concentrate on that area. 

The characteristics of a good marketing and user training program are 
already known to the OTIS staff. They recognize its components even if in the 
past they have failed to arqploy them. We state with certainty the necessity 
of concentrating on the marketing and communication problems. We cannot pre- 
dict that they can recover from their current image. Moreover, the sophisti- 
cation of their ultimate service objectives is such that we are concerned with 
the educational coaimunity's ability to appraise its full potential and worth 
to them. 

These failings, if not overcome, would force us to conclude that OTIS 
cannot succeed or survive. However, with such a large investment at this point, 
it is reasonable to suggest specific recommendations designed to correct these 
failings* 

These suggestions are based on the assunption that OTIS will be willing to 
initiate the correction of its coordination faults and the effective communi- 
cation of its unique service advantages to educators in the state. 

OTIS should meet the following requirements in these areas : 

A. Inmediately develop a specific, systematic marketing plan listing: 

1. All potential users. 

2. Individual strategies designed to insure contracts. 

3. OTIS' s accounting for each potential user by documenting 
refusals and contract acceptances, expecting to be periodically 
measured by the number of such acceptances. Failure to obtain 
enough contracts to establish the required student base by 
Noveniber warrants the Department's withholding of project funds. 

B. Simultaneously establish an internal costing and control reporting 
system to: 

1. Determine OTIS's actual operating costs. 

2. Determime the required student base to fund OTIS's operation. 

C. Develop an operations schedule listing: 

1. I'm implementation dates through November for "Query" and 
related software routines that will allow real time inquiry 
and response on OTIS's data base. 
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2. Methods and dates of stepped-up in-service training for all 
levels of present and potential users. 

3. The staff should expect evaluation of their schedule achieve- 
ment by reporting to the department their progress through 
November. 

Whether OTIS should be given the chance to implement these recommendations 
is a matter for management decision* Ihe apparent time constraint is an ob- 
vious qualification on the probability of these reconmendations yielding a 
beneficial result. If a decision to continue OTIS is made, the decision to 
endorse OTIS must accompany it. Without such an endorsement from the Depart- 
ment of Education and other appropriate agencies, the potential for success is 
eliminated. 



If you should have any questions, please contact Mr. John Maddocks of our 
Portland office, or Mr. Floyd Bowers of our Sal«n office. 

Very truly yours. 

Certified Public Accountants 



PREFACE 



The objective of this document is to describe a plan for orderly 
evolution of Automated Data Processing (ADP) as a tool in the 
administration of state government* The implementation of the 
plan should provide a base on which a total responsive informa*- 
tion system for the State of Oregon can be built. 

This plan was conceived after conducting a review of all state 
agencies that use or contemplate near future use of data processing. 
Input Included a December 1968 survey supplied by each agency in 
standard format, and face-to-face discussion with most Involved 
agencies » such as Highway, Motor Vehicles, State Police, Employ*- 
ment, Welfare, Tax, Public Utility Commissioner, etc. 

The review Included existing and proposed applications, hardware 
and personnel. The contributions of four intr^rested computr vendors 
have also been incorporated. 

A TEAM APPROACH 

A team was appointed by the Governor's Office on December 1, 1968 to 
analyze Automated Data Processing within the State of Oregon and submit 
reconmendations for the effective use thereof. 

The team members were as follows: 

J. V. Wilson - Chairman Division Accounting Manager 

Pacific Northwest Bell 

Planning & Procedures Manager 
Pendleton Woolen Mills 

Systems Analyst 
Department of Finance 
State of Oregon 

Programing Manager 
Pacific Power & Light 

Director of Data Processing 
Oregon State Board of Higher Education 

Director Administrative Services 
Board of Health 
State of Oregon 

State agencies were asked for their plans for use of Automated Data 
Processing for the next five years. Formal replies were received. 
Agencies were visited and discussions were held with Directors, ADP 
Managers, and other Interested parties. 



R. A. Burkholder 

L. J. Berber ger 

D. W. Price 

G. C. Schmitz 

G. R. Youngblood 
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SDUCATION 

The diagram on page 12 shows a proposed consolldatioD effort cm three 
fronts as the Initial objective for Oregon's educational functions. 

1. Higher Education has today a five year plan for developmnt 
and Implementation of business office applications for all 
Institutions. We feel that this Is a sound objectlvet but would 
recommend that those non-lnstructlonal applications » such as 
registration^ student records^ class schedullng» etc.» not 
Included In the present plan^ be reviewed for possible 
inclusion at a later date. The proposed funding for 69-71 
appears reascmable. 

2. In another section of the education covn]nlty» we see many 
school districts in Oregon initiating separate projects to 
automate school administrative services. At the same time we 
find that Oregon has an operating facility*— OTIS—that was 
federally funded and designed to provide similar aervices. 
The Federal sponsors of OTIS are pleased with the results of 
the project » and other stateSt recognizing a successful $1.5 
million development* plan to adopt the system for themselves. 

The Oregon System of Education can 111 afford to let "pride 
of authorship" sentlir.ents in system design and a possible mis- 
understanding of expenses result in their rejection of OTIS 
without a thorough evaluation. 

It is our recommendation that the Department of Education* all 
Conmunlty Colleges* and all I.E.D. *s plan to share a computet 
facility. Assuming a favorable evaluation* OTIS in present 
location* Eugene* is capable of considerable growth and 
would provide an excellent Initial facility. 

Further assuming a favorable evaluation* immediate action should 
be taken to place OTIS under State control* reporting to either 
the Educational Coordinating Council or the Department of 
Eudcation such that it could qualify for an educational discount 
on equipment. Such a discount would amount to approximately 
$240*000 over the next biennium on the presently Installed 
OTIS equipment. 

No additional funding other than that proposed should be 
required in the next biennitmi provided the educational 
discount on equipment could be realized. 



Our final front eocompasses the vast area of computer usage 
described as Instructional* Today we find Instructional 
computer centers In many of Oregon's Institutions of Higher 
Education, cojBDunlty colleges and even elementary schools. 
In addition^ there Is a continuing demand for more computer 
capacity in each of these centers* Recently, the demand for 
use of a larger facility required one of the Institutions of 
Higher Education to contract for the services of a very large 
service bureau facility* 

Our recommendation in this area is that the present computer 
committee in Higher Education study the potential value of a 
large Instructional computer facility that could serve all of 
the Oregon Educational Community* The establishment of such a 
facility would not preclude the need for instructional computer 
centers at various educational institutions, but could well 
save the State millions of dollars in the proliferation of 
large centers on all campuses that would not be efficiently 
utilized* 

Additional funding of $50,000 is recommended to employ the 
services of a consultant to aid In the acconvlishment of this 
study by September 1, 1969* 



« 
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OREGON BOARD OF EDUCATION 
Public Service Building 
Salem, Oregon 97310 
Dale Pamell, Superintendent 



Division of Instruction 
Title III, ESEA 
June 11, 1969 



PROJECT OTIS CONTINUATION REQUEST 



Lane County lED 



Title III, ESEA 



Background 



The enactment of P.L. 90*247 in 1968 (amending the Elementary and Secondary Education 
Act of 1965), transferred Title III, ESEA administration from the U.S. Office of 
Education to the states. The amendments required that a state plan be submitted to 
and approved by the State Board of Education and the U.S. Office of Education. Upon 
the termination of U.S.O.E. grant awards, the outgoing Title III projects were Issued 
grant awards by the State Department of Education to complete originally approved 
budget periods. The Office of Education's grant award to Project OTIS terminated 
on February 28, 1969. To complete its budget period ending June 30, 1969, a grant 
in the amount of $254,744 (effective March 1, 1969) was awarded to OTIS by the 
State Department of Education. 

Provisions for Continuing Projects 

Section 2.3.20 of the 1969 Title III, ESEA Oregon State Plan provides for the con- 
tinuation of on-going projects for an additional budget year through negotiation by 
the Title III Administrative Staff and the project staff, providing evidence has been 
submitted and that the project is subjectively meeting its outlined objectives. 

OTIS Evaluation Review 

To review the progress of Project OTIS and to satisfy the requirements of the Contin- 
uation Request provisions under Title III, the firm of Touche, Ross, Bailey, & Smart 
was contracted and the review was conducted between May 5 and June 3, 1969. The 
summary of the evaluation review report is found in the exhibit accompanying this 
request. 

RECOMMENDATION 

The Superintendent RECOMMENDS that the Oregon Board of Education approve the Project 
OTIS Continuation Request for Title III moneys in the amount of $458,332 for the 
fiscal year ending June 30, 1969. 

It is FURTHER RECOMMENDED that the Oregon Board of Education: 

1. Commend OTIS for its exemplary and innovative work in educational data processing 

2. Endorse OTIS as a Data Processing Service which has exceptional worth and merit 
to local school districts. 



3. Direct the State Department of Eiucatlon to evaluate OTIS as a Computer Resource 
Center suitable for Its own data processing requirements. 



4. Direct the State Department of Education to form an advisory committee for the 
use of data processing In education In Oregon. This committee should develop 
and submit proposed guidelines for data processing use by November 1» 1969* 

5. Encourage local school boards to evaluate 0«^IS potential service to them and 
the State Department's guidelines for data processing In education before com- 
mitting to further decisions in the d^la processing area. 



Moved by Action taken 



Seconded by_ 



ERIC 



Unr> STANIlAKl) IM.AV.A 
I'CiWI I.A Sl>. f>!*r:<^.ON <>7i?oa 

June 9, 1970 



Mr* Clarence K. Mellbye 
Coordinator, Title III ESEA 
Oregon Board of Educa t ion 
942 Lancaster Drive, N. E. 
Salem, Oregon 97310 

Dear Mr. Mellbye: 

We have completed our evaluation of the marketing and user 
training activities of the Oregon Total Information System (OTIS), 
which were initiated as a result of recommendations in the Title III 
evaluation dated June 4, 1969. This letter report describes the 
activities we performed in conducting the evaluation and summarizes 
our findings. 
EVALUATION SUMM;^RY 

In general, the marketing and user training programs were 
all designed and based on realistic, practicable concepts. The 
plans established in August, 1969 were substantially followed during 
the subsequent months by the Field Services Division. As a result, 
the reputation of OTIS, judged by user response, has greatly improved. 
The only deficiency we believe worthy of comment is the failure to 
have included in the plan? criteria for measuring their achievement. 
The effectiveness of the programs cannot be expressed quantitatively 
in absence of pre-established explicit targets to measure the success 
of the programs. 
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The primary rbstacle facing OTIS in marketing its services 
is cost. Our discussions with school district personnel indicate 
that a combination cf what, in their opinion, is excessive cost for 
the service provided and taxpayer resistance expressed in budget 
electionsi create a marketing problem for OTIS. Personnel at OTIS 
are continuing to develop strategy designed to overcome the problem. 
STUDY METHODOLOGY 

We performed the following tasks in evaluating the marketing 
and user training activities performed by OTIS. 

1. Discussed and reviewed with OTIS management the plans developed 
at the start of the 1969-70 year for marketing and user training. 

2. Discussed with OTIS management the actions taken during the year 
in regard to the plans for marketing and user training. 

3. Obtained from OTIS copies cf letters, memos, and other documents 
used in marketing and user training. 

4. Obtained from OTIS information for use in evaluation. This 
information dealt with such areas as improved utilization, reduced 
errors, improved understanding by users and potential users, improved 
user satisfaction, etc. 

5. Reviewed impressions of the marketing and user training efforts 
by the school districts contacted by OTIS. 

6. Analyzed the infcrmatirn obtained in performing the tasks listed 
above to evaluate the plans and acicns taken m regard tc marketing 
and user training. 
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SITMMAKY OF FINDI NGS 

The activities undertaken by OTIS to develrp and carry cut 
a marketing and user training program are described in the fcllowing 
paragraphs : 

( a) Marketing and User Training Plan 

A written plan for marketing and user training for the 1969-70 
school year was summarized during August, 1969. The plan was developed 
by OTIS personnel with outside assistance from consultants and equipment 
vendor personnel. 

The plan was based on several key concepts, including: 

1. Present users must be satisfied with OTIS before other 
school districts would accept its services. 

2. A major element of the marketing activities should utilize 
communication between peers (Superintendent to Superintendent, Board 
Member to Board Member, etc.). 

3. OTIS must offer a desired and reliable service at prices 
which are economically feasible. 

4. Personnel in addition to those in the Field Services 
Division must be involved in the marketing effort. 

5. The marketing effort should be oriented toward dc^cision 
makers - Superintendents, Board Members, Principals, etc. 

The activities followed in carrying out the plan included; 

1. Coordinator workshops and area meetings to provide current 
users with more complete understanding of OTIS and data processing and 
to determine specific problem areas requiring attention. 

2. Intensive training efforts for the two new districts 
(Dallas and Tillamook) to facilitate a smooth transition to the OTIS 
system . 

3. Regional meetings to present material on data processing 
and OTIS to potential users and tc . l^-^ntify those districts which were 
sufficiently interested to justify fcllt^w-up activities. 
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4. Follow«-up activities with individual school districts, 
based on their degree of interest » 

5. Miscellaneous publicity activities, such as booths or 
presentations at conferences, feature stories in newsp^jpers, contacts 
with professional and other organizations, etc. 

The marketing and user training plan appears to be well 
designed. It is based on realistic concepts (user satisfaction, 
economics, peer group communication, etc.). The planned activities 
were oriented toward those districts and I.E.D.'s offering the great- 
est new user potential. The major shortcoming of the plan is the lack 
of specific measurable objectives which could be used subsequently in 
evaluating the results of the marketing and training activities. We 
recognize, however, that it would have been extremely difficult to set 
SMch objectives on a realistic basis for the first year of the program. 
The experience gained during the fir.st year will facilitate the setting 
of realistic objectives for subsequent years, 
( b) User Training Activities 

The user training activities performed during the year included 
those described above - the coordinator workshops, area meetings, and 
the training efforts for the Dallas and Tillamook school districts. Our 
interviews with the school districts indicate that these efforts were 
effective in improving OTIS' reputation with its users. (In the case 
of Tillamook, utilization will be expanded to all schools in the county 
next year) . 

One drawback has been the inability of some school districts 
to assign a coordinator with sufficient time •to do an adequate job. For 
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those school districts which have supplied sufficient coordintitor tjmc. 
however, the training has uided the coordinators in helping the district 
better utilize OTIS* services* In addition to the user training octivi- 
ties described above, the Field Services personnel performed a number 
of other activities in response to needs as they occurred, for example* 

1. User manuals for the two types of terminals used with OTIS 
were re-written. The new manuals are in simple, non-technical lanquocjo a 
make good use of photography to illustrate the various terminal oporo- 
tions. The new manuals appear to be a significant improvement as borne 
out by comments in our interview with users . 

2. A training course for school secretaries was conducted at 
Lane Community College and drew high attendance from the Lane County 
Schools. Our contacts with the school districts showed that the 
secretaries regard the classes as effective. The course covered many 
basic computer concepts and makes use of several films. 

3. Classes for teachers and administrators were conducted at 
Coos Bay and Cottage Grove, through the Division of Continuing Education 
Participation at Coos Bay was good, but the Cottage Grove class drt^v\; 
.less interest. These were two unit courses, the initial unit dealing wi 
basic computer concepts: the second with the computer's use in education 
The course appears to be well designed around its objectives. It makes 
good use of a variety of material, including films. 

4. Memos to OTIS users, on approximately a weekly basis, have 
been issued since October, 1969. These memos are used to advise users 
on any matter of general interest, such as common problems and their 
solution? new services; changes in present services, OTIS organization, 
etc. Our interviews indicate that these mfemos have been effective in 
improving communications. 

( c) Marketing Activities 

Th^ marketing efforts during the year generally followed the 

marketing and user training plan. The following paragraphs describe 

the major activities performed and summarize our evaluations. 

Area Meeting^s , The area meetings appear to have been an 
effective means for expJdining the OTIS services. The meetings included 
participation from personnel cf the Oregon Board of Education , present 
users to provide peer group communication, and members of the OTIS staff 
other than the Field Services Division. 
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which displayed a dc^jrcc- cf interest an the i\rc.\ moot i n.^^ w-M'^ si^Iivm- -vl 
for ndividual fcllcw-up 7*^e frllc^w-up wjis keyed tc vho [vi-'pt-v-* * 
level and type cf interest. 

Cur interviews mdacated t^^t the maicrity cf t!io prc^pc^cts 
were favorably impressed with both the area meetings and the indivuU;al 
contacts. These contacts have resulted in an improved under stand i nq 
of OTIS and a more favorable impress ion of it. 

The major single reservation about using OTIS was the cost. 
In dealing with this reservation, the Field Services Division was able 
to develop an approach whereby a user could accept less than the total 
package, with a corresponding reduced cost. The effectiveness of this 
approach is evidenced by the fact that of the seven new users (school dii 
tricts or I.E.D.'s), only one, the Tillamook County I.E.D,, has selected 
the full package. Despite the availability of partial packages, many 
potential users still regard the cost as too high. 

Additional factors which may have limited the number cf new 
users were the general eccncmic conditions, the uncertainty of some 
school districts or I.E.D's which were considering possible merger with 
adjoining districts, and a degree cf uncertainty about the future cf 
OTIS . 

The area meeting activities and individual follcw-up activi- 
ties were reported tc OT:s management through internal repcrts. These 
reports described the degree jnd typo cf interest shown by the school 
districts and I.E.D 's and served js the basis for planning further 
follcw-up activities. 
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A final feature of the market inq activities is Huit Mu^y wcro 
planned and carried out as much as possible to fit into the vonrlv cyolo. 
Efforts were made to get the mossoge to the key decision luakerp m titva^ 
for them to include the costs in the budget. 

During May, 1970, the OTIS Field Services Division initiated 
its own questi^onnaire to obtain evaluations by the users regarding the 
services they receive. The 262 responses were summarized using one of 
the OTIS Programs. The survey bears out that users now have a generally 
favorable impression of the services they receive. Future surveys will 
have a basis for comparison to determine the direction and degree of 
change in user attitudes toward OTIS services, 
( d) Miscellaneous Publicity 

The OTIS marketing effort has included a number of activities 
designed to provide wider and more favorable publicity. Presentations 
have been given before the State Principal's Conference^ Association 
for Education Data Systems, and the PPBS workshop. Contacts have been 
developed with the institutions of higher learning and the N. W. Regional 
Laboratory. Feature stories have appeared in newspapers in six to eight 
cities and in "Your Taxes" published by Oregon Tax Research. 
CONCLUSION 

The marketing and user training plan was based on realistic 
concepts and included sound approaches for improving the OTIS reputation 
among present users and for communicating its services to potential users. 

Our interviews indicate that the present users fecfl that the 
timeliness and accuracy of the services they receive from OTIS c..id the 
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quality of their ccmmunica ticns from CTJS have cjreutly jmprc.ved over 
the past year as a result of the marketing and training effcrts. Cur 
interviews with potential users indicate that their cpinic n of OTIS has 
similarly improved, although cost stall remains a major obstacle to 
wider utilization. The marketing activities have -resulted in additional 
users who are expected to prcvide approximately $59,000 in revenue during 
the 1970-71 year. 

Based on the indications mentioned above, we believe the 
marketing and users training efforts of OTIS during the 1969-70 year 
have been effective, although we are unable to quantify the resulting 
versus planned achievement. 

****** 

During the course of our work on the study we received the 
best of cooperation from CTIS personnel and individuals contacted in 
the school districts and I.E.D. 's. We are grateful for this assistance 
and appreciate the many courtesies extended to us. 

Yours truly , 
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TO: Mr, Keruieih Stanhope, Chairman 

Advisory Committee on Educational Data Processing 

FROM: Subcommittee on Review of Oregon Total Informati on 
System (OTIS) 

SUBJECT: Subcommittee Report on OTIS 



The subcommittee appointed by you at t!ie first meeting of the Advisory 
Committee on Educational Data Processing has reviewed the present status 
of the Oregon Total Informat io n System (OTIS) and respectfully submits 
this report. In order to meet the deadline for reporting by the second 
meeting on January 14, 19/0, the subcommittee has restricted its review 
and Its recommendations to the question of whether the full committee 
should take a position concerning OTIS's future existence as a service 
to the school districts of the state of Oregon. Our recommendation with 
reasons summarized in Part I. Several necessary observations relating 
to the subcommittee's findings are presented in Part II. 



PARTI: RECOMMENDATION 

r J C ommittee should recommend the continued existence of OTIS as a 
da> ^ p..occs siii g service organization for school d istricts, 

OTIS provides a range of business, student service and educational data 
processijig programs that cannot be obtained from any other one source in 
Oregon. 

OTIS provides record keeping, reporting, etc. , that are in compliance or 
conformance with State requirements. This is very important since school 
districts must operace under those reporting requirements. Commercial 
service bureaus and other sources that are not specifically oriented to 
Ox*egon school administration may be able to meet the requirements directly 
or may only be able to provide outputs that would have to be adc^ptcd by 
^ the customer to Oregon requirements. 
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After an inilial period of difficullics, which is normal for any new organizntion 
of its type, OTIS has made substantial improvements in its programs and 
operations. 'Hie staff luis benefited from sigiiificant reorganization and 
personnel changes that have been made recently. The effect of improvements 
has been reflected m favorable comments and compliments received from 
customers in recent weeks as compared to the criticisms received earlier. 

A large school district with adequate manpower and financial resources could 
conceivably provide for itself the same variety of data processing services 
that OTIS offers. A school district with employees who are knowledgeable 1ji 
the data processing field might secure "packaged" services from commercial 
sources or otiier non-profit service organizations. However, the majority 
of school districts in Oregon at this time are neither large enough to be self 
sufficient nor staffed with urahied staff that could effectively manage a 
program of procured services from commercial vendors. Thus, OTIS stands 
in a unique position today in being able to (1) provide a wide r mge of services, 
(2) that are oriented to State requirements, (3) thaough a competent staff 
that has gained wide experience in dealing with the data processmg needs and 
problems of Oregon school districts. 

This recommendation does not constitute an unconditional or unqualified 
endorsement of OTJS to every school district in the slate. Each school 
district must, in the final analysis, make its own determinations as to 
wliether (1) it needs one or more types of data processing services, (2) can 
afford the cost of such services, and (3) whether OTIS would be the best 
source of services. There are a number of considerations that must be 
examined wliich will vary according to such factors as size, location, quality 
of present programs and procedures, availability of alternative or competitive 
service organizations, and financial condition. In the second part of this 
report, we will touch upon some of these considerations. 



PART II: OBSERVATIONS 

The subcommittee in making its review of OTIS noticed a number of conditions 
or situations that poijit to the need for the type of study the Advisory Committee 
on Educational Data Processing was established to perform. Several of the 
most significant are discussed below. 

A. Need for Definitions and Guidelines. 

Reports and other literat^jre dealing with educational data processing in 
Oregon emphasize hardware. The tendency has apparently been to 
"computerize'' existing procedures or systems and to allow the hardware 
to determine criteria and guidelines for current operations and future cliangc. 



The primary need is to reassess our inforinalion requirements from 
both the administrative or business management viewpoint and from the 
educational use viewpoint. Out of this reassessment should come yonl 
definitions, staiidards and criteria a)id guidelines to direct and assist 
school districts in acquiring daUi processing services. 

B. Need for Tcclir.ical Systems Assistance. 

Even after basic statewide objectives are defhied most school districts 
do not have trained personnel to handle the analysis and systems 
development work that is necessary to an economical and efficient 
transition from manual to computer oriented procedures assuming such 
a change is beneficial, Fo3' example, the determination of comparative 
benefit -to-cost relationships which is a key tool for objective decision- 
making in such cases is dependent upon the ability to identify accurately 
current costs and projected future costs. Even OTIS is not able to cost 
its services and programs in detail but works on the basis of overall 
per -ADM annual costs for the complete package of services. 

The State Department of Education is the logical agency to coordinate and 
provide systems analysis assistance to school districts. While tlie 
Department cannot directly provide all the assistance needed by school 
districts, it should be in a position to help tliem obtain systems analy&>«? 
services where its own personnel cannot provide direct assistance. 

C. Need to Identify Sources for Educational Services. 

While OTIS should be endorsed and supported, by its own statements 
OTIS can handle a maximum clientele of about 150,000 ADM. OTIS 
was never intended to be the only statewide central service center. 
Therefore, the data processing needs of the majority of Oregon primary 
and secondary schools must be served by other means. The Department 
of Education has to provide assistance in locating or selecting various 
alternate ways of securing data processing services. OTIS represents 
only one way that these services can be provided. Before such 
alternatives can be determined, however, the needs must be defined 
and methods for evaluating between alternatives have to be developed. 

CONCLUSION 

OTIS is presently a unique source of data processing services for elementary and 
secondary school districts in Oregon. OTIS is operating effectively now and is 
continuing to improve its programs and its operations. OTIS is not the ultimate 



answer to siatcwidc educational data proccysijig needy. However, 0T1»S could 
be a model for a sUilcwide plan in many respects; and OTIS can definilely be 
a major element in tlie ultimate program for providing services. Therefore, 
OTIS needs to be supported ujitil (1) a state plan is developed and implemented 
and (2) its place in tlie plan is determined or a better means for serving OTIS 
customers is established. 
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